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The  purposes  of  this  study  were  to  (a)  develop  and 
administer  an  instrument  for  assessing  user  satisfaction 
with  health  care  provided  by  a university  health  service, 
(b)  assess  validity  and  reliability  of  the  instrument,  (c) 

(d)  compare  user  satisfaction  at  time  of  service  delivery 
and  at  a later  time,  and  (e)  provide  administrators  with 
information  used  for  improving  health  care  in  that 
institution,  as  steps  toward  developing  a model  for  use  in 
the  subject  institution. 

Using  the  Recurrent  Institutional  Cycle  design,  I 
established  a model  framework  for  assessing  users' 


>f  health 


quality  recei\ 


university-setting  health  service  and  provided  baseline 
data  for  this  cyclical  quality  assurance  activity. 

I developed,  pretested,  and  administered  a questionnaire 
including  a multidimensional  assessment  that  yielded  a 
satisfaction  index,  to  409  of  952  users  visiting  the 
facility  during  3 days  of  the  spring,  1984  academic  term. 

of  10  neutral  items.  The  index  was  used  to  compare  (a) 
satisfaction  of  health  service  users  completing  questionnaires, 
when  users  were  grouped  by  self-reported  responses  to  10 
additional  questionnaire  items,  and  (b)  responses  of  a 
subgroup  of  survey  respondents  on  questionnaires  completed 
immediately  after  the  health  care  encounter  and  2 to  4 
weeks  later.  The  study  subgroup  was  160  of  409  users 
completing  the  initial  questionnaire  administration. 

Questionnaire  validity  and  reliability  were  assessed. 

Data  collected  were  examined  using  item  and  factor  analysis 
and  analysis  of  variance  regression.  Two  significant 
findings  were  generated  relating  to  users  who  participated 
in  the  initial  administration  of  the  questionnaire:  (a) 

those  aware  of  the  appointment  system  were  more  satisfied 
than  those  unaware  and  (b)  those  who  waited  less  than  15 
minutes  to  see  a health  care  provider  were  more  satisfied 
than  those  waiting  15  to  60  minutes.  No  significant 
difference  was  found  between  subgroup  responses  when 
questionnaires  were  completed  immediately  after  care 
encounters  and  2 to  4 weeks  later. 


Recommendations  were  included  for  improving  the 
instrument  and  administration  methods  in  future  user 
satisfaction  data-collection  cycles  at  the  subject 
facility. 


CHAPTER  I 
INTRODUCTION 


The  rise  of  consumerism  has  increased  interest  in  the 
satisfaction  of  patients  with  the  delivery  and  quality  of 
services  that  health  care  facilities  provide.  Such  factors 
as  new  and  sophisticated  medical  equipment  and  treatments, 
soaring  health  care  costs,  inequitable  distribution  of 
health  care  providers,  and  growing  dissatisfaction  with 
marginal  increases  in  health  status  have  fueled  this 
interest.  Health  consumerism  has  spread  to  all  segments 


Assessing  the  quality  of  care  that  health  service 
facilities  provide  is  a complex  but  necessary  activity. 
Those  providing  the  service  need  information  to  plan, 
maintain,  modify,  and  improve  current  and  future  health 

the  quality  of  health  care  through  quality  assurance  progrs 


medical  audits 


itisfaction 


sys  (Nelson-Wernick,  Currey, 


and  patient  sa 
Taylor,  Woodbury, s Cantor,  1981). 

The  Joint  Committee  on  Accreditation  of  Hospitals 
(JCHA) , a group  responsible  for  accrediting  all  hospitals, 
including  college  health  services,  mandates  that  quality 
of  care  be  monitored  in  accredited  facilities.  JCHA 
accreditation  requires  that  institutions  follow  detailed 
standards  relating  to  organization  and  administration  of 
health  service  facilities.  The  standards  promote  broad, 
systematic  screening  and  evaluation  of  information  about 
important  aspects  of  patient  care.  In  order  to  determine 

the  standards,  JCHA  representatives  conduct  site  visits. 
Assessment  of  patient  satisfaction  with  health  care  is  one 
aspect  of  ongoing,  systematic  monitoring  of  quality  and 
appropriateness  of  patient  care  ("Quality  Assurance,"  1984). 

JCHA  accreditation  does  not  guarantee  high  quality 
health  care  but  is  a form  of  consumer  protection.  A lay 
person  examining  a health  care  facility  is  often  unable  to 
judge  the  overall  quality  of  care  at  that  facility.  JCHA 
accreditation  places  the  responsibility  for  health  care 
supervision  in  the  hands  of  medical  experts  who  can  better 
observe  day-to-day  procedures  and  policies  in  action 
(Corry,  1983,  pp.  140-143). 

If  typical  health  service  users  lack  technical 


judge 


quality  of  health  cars 


why  is  the  collection  of  patient  satisfaction  data  an 

factors  relate  to  this  question. 

Though  lacking  in  technical  medical  expertise, 
patients  (users)  make  many  decisions  in  the  health  care 
process.  Patients  decide  (a)  when  they  are  ill  (Berkanovic 
& Marcus,  1976),  (b)  who  to  see  for  health  care  (Larsen 
& Rootman,  1976) , and  (c)  whether  to  follow  the  prescribed 
treatment  regime  (Davis,  1968) . Patients  make  crucial 
decisions  about  access  to  medical  care  and  compliance  with 
prescribed  treatments  based  on  their  attitudes  about 


Quality  of  Care  in  Student  Health  Service  Facilities 
According  to  the  American  College  Health  Association 
(ACHA) , the  major  goal  of  a college  student  health  service 
is  the  promotion  and  maintenance  of  conditions  that  permit 
and  encourage  individuals  to  attain  optimal  physical, 
emotional,  intellectual,  and  social  well-being  (American 
College  Health  Association,  1970) . This  major  goal  remains 
unchanged  today.  To  accomplish  this  broad  goal,  a student 
health  service  in  a college  setting  must  attract  appropriate 
student  use.  Investigators  have  identified  satisfaction 
with  health  care  as  a major  factor  influencing  student  use 
of  campus  health  services  (Burke,  1974;  Donabedian,  1980; 
Taft,  1976) . 

Regardless  of  their  lack  of  technical  and  medical 


about  the  quality  of  care  they  receive.  These  judgments 
influence  students  in  their  use  of  campus  health  services. 
Furthermore,  health  service  users  probably  share  their 
evaluations  of  student  health  facilities  with  their  peers, 
broadening  the  impact  of  these  judgments  and  underscoring 
the  importance  of  user  assessments  of  quality  of  care 
received  (Liao,  Banahan,  McDaniel,*  McKay,  1978).  Since 
college  health  service  users  are  also  making  decisions 
regarding  the  use  of  health  services,  college  health 
administrators  have  come  to  realize  the  importance  of 

(a)  emphasizing  factors  having  a positive  influence  and 

(b)  avoiding  factors  having  a negative  influence  on 
consumers'  attitudes  about  health  care  (McDaniel,  1979). 

Evaluators  can  assess  patient  satisfaction  at  many 
levels.  Findings  have  profoundly  different  implications 
depending  on  the  setting  in  which  care  is  delivered  and  the 
aspects  of  the  care  that  respondents  are  evaluating. 

Specific  needs  for  patient  satisfaction  assessment  are  as 
diverse  as  are  characteristics  of  individual  health  care 
facilities. 

College  health  service  settings  are  similar  in  that 
populations  of  the  respective  campuses  are  relatively 
homogeneous  and  services  are  frequently  prepaid  to  some 
degree.  However,  even  staffs  of  college  health  facilities 
have  varied  needs  for  patient  satisfaction  data.  Differences 
in  services  institutions  provide,  quality  of  facilities. 


and  the  nature  of  health  service  staffing  necessitate 
creation  of  valid  and  reliable  instruments  for  assessing 
patients'  attitudes  about  health  care  students  receive  in 
specific  settings. 

The  goal  of  assessing  quality  of  care  in  health 

health  care  services  ("Quality  Assurance,"  1984).  Even 
though  assessment  of  the  quality  of  health  care  includes 
factors  influencing  usage  of  and  satisfaction  with  health 

health  care  services  provided  in  one  university  health 


prodi 


uct  or  uses  a service,  the 
tendency  is  to  pat  oneself  on  the  back  for  making  a 
good  choice,  positively  skewing  responses.  For  this 
reason,  investigators  must  look  closely  at  any  aspects 
of  patient  satisfaction  that  clients  rate  below  the 
highest  level  of  satisfaction  on  assessment  instruments 
(Osterweis  & Howell,  1979). 

Effects  of  cognitive  dissonance  may  be  offset  in  a 
college  health  service  setting  because  many  student  users 
are  not  aware  that  they  purchase  the  care  they  receive 
there  (McDaniel,  1979).  In  some  college  settings  such  as 
at  the  subject  university,  prepayment  for  health  services 
is  included  in  tuition  or  activity  fees.  For  this  reason, 

health  services. 

Even  though  payment  for  health  services  is  included  in 
tuition  fees  at  the  subject  university,  students  are 
probably  aware  that  they  are  paying  for  health  services 
because  the  tuition  bill  for  each  semester  includes  a 
separate  assessment,  called  the  health  fee,  for  using  the 
student  health  service.  Although  students  are  probably 
aware  of  their  prepaying  of  a health  fee  at  the  subject 
university,  the  effects  of  cognitive  dissonance  may  be 
offset  by  the  fact  that  payment  of  the  health  fee  is 
mandatory  for  full-time  students  (students  registered  for 


id  optional  for 


part-time  students  (students  registered  for  fewer  than 
seven  semester-hour  credits) . For  either  full-  or 
part-time  students,  attention  is  drawn  to  payment  of 
the  health  fee  each  semester  when  students  of  the  subject 
university  are  paying  tuition  fees. 

Statement  of  the  Problem 
Patient  satisfaction  research  in  college  health 
facilities  has  become  increasingly  popular  yet  generally 
yields  data  of  questionable  value.  Limited  time,  funding, 
and  research  knowledge  of  many  user  satisfaction 

research  based  on  analyses  of  those  findings.  Additionally, 
replicating  patient  satisfaction  research  is  difficult 
because  the  goals  of  assessing  user  satisfaction,  as  well 
as  the  means  of  acquiring  patient  satisfaction  data,  vary 
according  to  staffing,  clients  served,  and  the  variety  of 
services  a particular  health  service  facility  offers. 
Consequently,  investigators  of  user  attitudes  toward  health 
care  in  college  settings  can  make  few  generalizations  based 
on  accurate  and  efficient  collection  and  use  of  satisfaction 
data. 

Purpose  of  the  Study 

The  primary  purpose  (Purpose  1)  of  this  study  was  (a) 
instrument  investigators  developed  and  administered  six  times 


during  the  preceding  4 years  in  the  student  health  service) 
with  which  to  assess  user  satisfaction  with  health  care 
provided  by  a university  health  service,  (b)  to  assess 
the  validity  and  reliability  of  the  instrument,  (c)  to 
test  the  instrument  through  the  collection  of  data  at  time 
of  service  delivery  and  at  a later  time,  and  (d)  to  compare 
the  level  of  user  satisfaction  at  time  of  service  delivery 
and  at  a later  time,  as  steps  toward  developing  a model 

A secondary  purpose  (Purpose  2)  of  this  study  was 
(a)  to  group  and  compare  survey  participants  by  their 
self-reported  responses  to  demographic  and  usage  questions 
contained  in  the  respondent-reported  data  section  of  the 
questionnaire,  (b)  to  compare  these  groups  and  their  mean 
levels  of  satisfaction  with  the  subject  student  health 
service  as  measured  by  the  Patient  Satisfaction  Index  (PSD , 
and  (c)  to  provide  administrators  of  the  subject  student 
health  service  with  data  organized  to  reflect  differences 

self-reported  characteristics  in  order  to  identify  problem 
areas  in  providing  student  health  care  in  that  institution. 

Background  of  the  Study 

Investigators  often  assess  patients'  attitudes  about 
health  care  at  a time  most  likely  to  provide  the  highest  retui 

health  service  facilities,  researchers  frequently  survey 


immediately  following  health  care 


5 delivery 
1979)  . 


(Mangelsdorff , 1979;  Osterweis  S Howell, 

In  assessing  both  satisfaction  and  usage,  investigators 
often  mail  survey  questionnaires  to  reach  the  appropriate 
population  (Liao  et  al.,  1978).  Assessing  usage  requires 
surveying  users  and  nonusers  of  a health  care  facility. 

facility,  investigators  survey  a sample  of  the  total 
student  body  by  mailed  questionnaires  to  locate  users 
and  nonusers  of  the  health  care  facility.  Investigators 
sometimes  collect  nonuser  data  through  home  interviews  but 
the  costs  of  this  method  often  prohibit  its  use  (Osterweis 
& Howell,  1979). 

Posavac  (1982)  used  mailed  questionnaires  because  they 
suspected  that  questionnaires  completed  by  patients  while 
still  hospitalized  would  be  nondiscriminately  favorable 
to  the  hospital  under  evaluation.  Users  would  be  rating 
satisfaction  with  health  care  before  they  were  aware  of 
the  outcomes  of  their  health  care  encounters. 

In  satisfaction  surveys  previously  administered  in 
the  subject  student  health  service,  investigators  collected 
satisfaction  data  immediately  following  health  care 
encounters.  In  this  way,  questioners  could  survey  a large 
percentage  of  those  using  the  student  health  service  during 
period.  The  statement  by  Care 


the  issue,  Would  ratings  of  patient 
satisfaction  be  different  when  patients  were  allowed  time 
to  assess  the  outcomes  of  their  diagnoses  and  prescribed 
treatments?  The  literature  contains  no  evidence  that  others 
have  addressed  this  question  in  research  in  college  or 
other  health  care  settings. 

Research  Hypotheses 

Beginning  with  a user  satisfaction  assessment  instrument 

in-house,  I incorporated  findings  from  previous  administratio 
of  that  instrument,  added  recommendations  from  investigators 
cited  in  the  review  of  literature  that  follows,  and  developed 

hypotheses : 

Purpose  1 

The  following  hypotheses  relate  to  the  development, 
assessment  of  the  validity  and  reliability,  and  testing  of 
the  subject  instrument. 

Hypothesis  A.  Users'  responses  to  the  open-ended, 

important  aspects  (dimensions)  of  satisfaction  that  were 
either  (a)  omitted  or  (b)  not  clearly  or  adequately 
addressed  by  the  patient  satisfaction  data  items  included 
in  the  Patient  Satisfaction  Index  (a  numerical  summary  of 


Hypothesis  B.  The  it 


talysis 


s study  of  interrelationships 
between  each  of  the  10  items  comprising  the  Patient  Satisfaction 
Index  and  the  index  itself  will  yield  item/index  correlation 

will  also  correlate  significantly  using  a 95%  confidence 
level  with  the  other  items  in  the  scale  (r  ■>  .40,  p < .05). 

This  hypothesis  represents  a test  of  item  homogeneity  for 
the  Patient  Satisfaction  Index. 

Hypothesis  C.  The  factor-analysis  study  of 
interrelationships  among  the  selected  domains  of  satisfaction 
and  the  Patient  Satisfaction  Index  will  yield  domain/index 
correlation  coefficients  greater  than  .40  (r  > .40,  p < .05) 
and  domain/index  correlation  coefficients  greater  than 
domain/domain  correlation  coefficients.  This  hypothesis 
represents  a test  of  domain  homogeneity. 

Failure  to  reject  the  preceding  three  hypotheses  will 
support  the  validity  of  the  1984  Patient  Satisfaction 
Questionnaire. 

Hypothesis  D.  Mean  Patient  Satisfaction  Index  values 
will  not  differ  significantly  using  a 95%  confidence  level 
when  users  are  surveyed  immediately  after  the  health  care 

2 to  4 weeks  later. 

Failure  to  reject  the  hypothesis  above  (a  test-retest 
measure  of  instrument  reliability)  will  support  the 


>ility  of 


Patie 


Satisfa 


The  following  hypotheses  relate  to  data  organized  to 
reflect  differences  in  the  satisfaction  of  groups  of 
respondents  categorized  by  their  self-reported  characteristics. 

Mean  scores  for  user  satisfaction  with  student  health 
services  as  measured  by  the  Patient  Satisfaction  Index  will 
not  differ  significantly  (using  a 95*  confidence  level)  when 
users  are  grouped  and  compared  based  on 

Hypothesis  E.  university  classification; 

Hypothesis  F.  the  number  of  times  the  user  has  been 
seen  by  a health  care  provider  at  the  subject  student  health 

Hypothesis  G.  the  patient's  awareness  of  the  appointment 
system  at  the  subject  facility; 

Hypothesis  H.  whether  the  patient  used  an  appointment 
for  this  particular  visit; 

Hypothesis  I.  the  length  of  time  the  patient  waited  to 
see  a health  care  provider; 

Hypothesis  J.  the  type  of  practitioner  providing  the 

Hypothesis  K.  services  the  patient  used  during  the 
health  care  visit; 

Hypothesis  L.  the  total  time  the  patient  spent  during 

Hypothesis  M.  whether  the  patient  did  or  did  not  have 


health  ii 


Hypothesis  M ■ 
problem  predicatir 


the  health 


Limitations,  Delimitations,  and  Assumptions 
Limitations  of  This  Study 

1.  Because  of  the  unique  character  of  each  patient 
satisfaction  research  effort  and  Setting,  investigators 
must  avoid  making  generalizations  beyond  the  health  care 
setting  of  interest.  The  generalizability  of  this  study  is 
further  limited  since  subjects  were  not  randomly  selected 
from  the  total  population  of  university  student  health 
service  users.  Subjects  were  nonrandomly  selected  from 
those  visiting  the  facility  between  8:00  a.m.  and  5:00  p.m. 
on  three  successive  days.  Results  are  characteristic  of 
the  study  group  only,  chapter  XV  includes  descriptive 
statistics  comparing  the  nonrandomly  selected  study  group 
to  the  total  population  of  potential  users  of  the  subject 
student  health  service. 

2.  The  follow-up  study  group  was  also  nonrandomly 
selected  from  those  participating  in  the  principal 
administration  of  the  questionnaire,  although  I instructed 

those  participating  in  the  principal  administration  of 
the  questionnaire  as  possible  to  participate  in  the  follow-up 
study,  performing  research  in  the  natural  setting  made  it 
impossible  for  them  to  request 
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principal  administration  survey  respondent  in  the  follow-up 
study.  In  situations  where  several  respondents  completed 
the  principal  questionnaire  administration  at  the  same 
time,  questionnaire  administration  personnel  decided  which 
respondents  to  ask  to  participate  in  the  follow-up  study. 
Also,  some  principal  questionnaire  survey  participants 
declined  to  participate  in  the  follow-up  study.  For  these 
reasons,  results  of  the  follow-up  study  are  characteristic 
of  the  subgroup  of  those  participating  in  the  principal 
administration  of  the  questionnaire  only.  Chapter  IV 
includes  descriptive  statistics  comparing  the  principal 
questionnaire  administration  study  group  and  the  follow-up 
subgroup  of  respondents. 

3.  The  use  of  bulk-rate  mail  for  administration  of 
the  follow-up  questionnaire  was  an  additional  limitation 
to  this  research  project.  The  use  of  bulk-rate  mail  made 
it  impossible  to  determine  if  nonrespondents  had  not 
received  the  follow-up  questionnaire  or  if  they  had 
received  it  but  failed  to  complete  and  return  it  to  the 
investigator.  The  use  of  bulk-rate  mail  probably  resulted 
in  a lower  follow-up  survey  response  rate  than  I would 

4.  An  additional  limitation  of  the  follow-up, 
test-retest  measure  of  instrument  reliability  was  a lack 
of  control  over  intervening  variables  that  may  have 
influenced  respondents’  perceptions  of  satisfaction  with 
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the  student  health  service  between  the  principal  and  the 
follow-up  administrations  of  the  questionnaire. 

5.  Due  to  numerous  surveys  taking  place  in  the  subject 
facility  at  approximately  the  same  time  period,  I pretested 
the  instrument  outside  of  the  student  health  service  facility. 
As  a result  of  this  decision,  I was  unaware  that  the 
instructions  for  completing  the  instrument  were,  in  some 
cases,  confusing  for  those  respondents  who  visited  the 
facility  only  to  use  the  pharmacy.  Because  a large  number 

of  respondents  were  in  this  category  of  respondents, 
approximately  25%  of  respondents  did  not  complete  the 

the  section  used  to  calculate  the  Patient  Satisfaction  Index. 

6.  According  to  the  literature,  mailed  surveys 
sometimes  yield  response  rates  as  low  as  10%,  while  50%  is 
considered  adequate  by  Babbie  (1973,  p.  165).  Respondents 
may  leave  some  questions  unanswered  when  completing  on-site 
or  mailed  surveys.  Therefore,  while  50%  of  mailed  surveys 

researcher  may  find  a much  lower  percentage  of  surveys  that 
include  responses  to  all  items  on  the  questionnaire, 
especially  when  sensitive  items  are  included.  According 
to  Bailey  (1982,  p.  158),  the  investigator  realizing  a 

surveys  to  be  as  low  as  10%.  Questionnaire  administration 
personnel  were  used  in  this  study  in  hopes  of  increasing 
the  percentage  of  usable  surveys. 
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Considering  the  citations  above,  I felt  that  the 
25%  rate  for  unusable  surveys  was  within  reasonable 

limitations.  Despite  two  pretestings,  the  instrument  I 
developed  had  not  had  prior  trials  in  other  research 
studies.  Also,  I constructed  all  questionnaire  items  in 
the  respondent-reported  data  and  patient  satisfaction 
data  sections  in  a forced-choice  format  (see  Appendix  A 
for  the  complete  survey  instrument) . Respondents  rated 
patient  satisfaction  data  section  items  on  a Likert  scale 
with  the  following  possible  response  choices:  very  satisfiec 

satisfied,  neutral,  dissatisfied,  very  dissatisfied,  and 
unable  to  answer.  Variable  interpretations  of  response 
choices  could  potentially  distort  study  results. 

8.  In  several  questionnaire  items,  respondent-reported 
data  were  collected  on  the  basis  of  accurate  participant 
memory  and  self-reporting.  Human  error  and  purposeful 
distortion  are  two  possible  consequences  of  questionnaire 
items  relying  on  participant  recall. 

9.  Data  collection  in  the  natural  setting  with  the 
advantages  and  disadvantages  of  working  in  the  real  world 
enhanced  the  practical  applicability  of  the  study  but 
limited  control  of  some  variables. 


ilimitatior 


)£  This  Study 


This  research  study  was  delimited  to 

1.  subjects  who  visited  the  subject  student  health 
service  during  the  3-day  data  collection  period, 

2.  subjects  who  participated  in  the  study 
voluntarily,  and 

3.  factors  affecting  user  satisfaction  with  health 
care  services  provided  at  one  university  student  health 
facility.  Factors  affecting  frequency  of  use  of  these 
health  services  were  not  the  focus  of  this  study. 

Assumptions  of  This  Study 

Implicit  in  these  limitations  and  delimitations  are 
the  following  assumptions: 

1.  Participants  responded  independently  to 


2.  Each  recorded  response  was  the  response  intended 
by  the  individual  completing  the  questionnaire; 

3.  Questionnaire  administration  personnel  and  data 
collection  procedures  did  not  influence  responses  of  study 


4.  The  time  period  for  data 
of  typical  student  health  service 


collection  was  representative 
usage  during  non-peak  periods. 


following 
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or  user  satisfaction  are  used  interchangeably  to  describe 
the  extent  to  which  users  are  pleased  or  displeased  with 
health  care  encounters  at  the  subject  student  health 
service  (Ware,  1981) . The  focus  of  patient  satisfaction 
research  in  this  study  is  users'  perceptions  of  the  quality 
of  care  they  received  in  the  health  care  facility.  In  this 
study,  satisfaction  is  assessed  by  items  relating  to  the 
personal  relationship  established  between  the  user  and  the 
health  care  professional,  the  professional  competence  of 
the  health  care  provider,  and  the  cost  and  convenience  of 
using  the  subject  student  health  service  for  health  care 
needs . 


Student  health  services  are  health  care  facilities 
operating  on  the  campuses  of  higher  education  institutions 
to  meet  the  health  care  needs  of  student  communities 


("Quality  Assurance,”  1984). 

The  Patient  Satisfaction  Index  is  a numerical  summary 
of  satisfaction  with  health  care  (Ware,  1981) . I gave 
numerical  values  to  the  Likert  scale  response  choices.  I 
totaled  respondents'  ratings  to  form  a numerical  summary  of 
satisfaction.  I did  not  compute  a satisfaction  index  for 
questionnaires  that  respondents  did  not  fill  out  completely 


Satisfaction  Index 


10  i 


the  patient  satisfaction  data  section  of  the  questionnaire) 
included  items  on  three  subscales  or  domains  of 
satisfaction  with  medical  care  and  services.  Unidimensionalitv 
is  a measure  of  how  well  items  included  in  one  subscale  or 
domain  related  to  only  that  one  dimension  of  satisfaction 
(Stamps  S Finkelstein,  1978) . This  term  was  also  used  in 
determining  how  well  all  patient  satisfaction  data  section 
items  (the  Patient  Satisfaction  Index  scale)  related  to  the 
single  concept,  satisfaction  with  health  care  received. 

designed  to  measure  the  extent  to  which  patients  are  pleased 
or  displeased  with  services  provided  in  a health  care 
facility. 

Patient  or  user  are  used  interchangeably  to  describe  any 
student  or  eligible  affiliate  seeking  health  care  or  related 
services  at  the  subject  student  health  service. 

Access  to  health  care  or  accessibility  are  terms  used 
interchangeably  to  describe  the  ability  of  users  to  obtain 
or  make  use  of  services  provided  by  a health  care  facility 
(Burke,  1974) . Access  to  health  care  includes  such  factors 
as  the  geographic  location  of  the  facility,  the  hours  of  its 
operation,  and  the  ability  of  the  staff  to  communicate 
effectively  with  patients. 
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A health  care  professional  or  provider  is  one  who 
gives  health  services  and  includes  physicians,  nurses, 
pharmacists,  dentists,  and  numerous  types  of  allied 
health  and  technical  personnel  (Boyles,  Morgan,  & McCaulley, 
1982).  These  terms  do  not  apply  to  administrative  and  other 
support  personnel  who  do  not  hold  medical  or  allied  health 
credentials  and  are  not  directly  involved  with  health 

Questionnaire  administration  personnel  were  ( a) 
employees  of  the  subject  student  health  service  from  the 
Quality  Assurance  and  Health  Education  divisions  and  (b) 
student  volunteers  who  managed  the  collection  of  patient 
satisfaction  questionnaires  during  the  3-day  data-collection 
period. 

Medical  treatment  regimes  are  the  activities  health 
care  providers  plan  to  improve  the  health  status  of  a 
patient  seeking  health  care  services  (Taft,  1976). 

response  options  that  are  mutually  exclusive  (e.g.,  yes 


Demographic  variables  are  characteristics  that  describe 
populations  or  subpopulations  of  individuals.  Investigators 
frequently  use  characteristics  such  as  age,  sex,  national 


21 

Usage  refers  to  the  consumption  of  health  care  services 
to  meet  the  health-related  needs  of  individuals.  Patient 
satisfaction  investigators  are  interested  in  (a)  availability 
of  health  care  services  to  individuals,  (b)  factors  promoting 
the  appropriate  employment  of  these  services,  and  (c)  barriers 
interfering  with  pursuance  of  health  care  provision  such  as 
the  lack  of  individual's  knowledge  about  how  to  use  a health 
care  system,  the  costs  of  using  that  system,  and  previous 
negative  experiences  within  a particular  health  care  system 
(Counte,  1979;  Ware,  1981). 

Quality  assurance  is  the  systematic,  comprehensive 
monitoring  of  the  quality  and  appropriateness  of  patient 
care  ("Quality  Assurance,"  1984). 

Organization  of  the  Study 

This  chapter  contained  an  introduction  to  the  study, 
an  explanation  of  the  problem,  and  a statement  of  the 

literature  related  to  the  assessment  of  patients' 
perceptions  about  the  health  care  they  receive  at  a specific 
facility.  Chapter  III  includes  research  methodology, 
instrumentation,  data  collection  procedures,  research 
design,  and  data  analysis.  Chapter  IV  is  a presentation 
of  descriptive  and  statistical  results.  The  final  chapter 
contains  a summary  of  findings,  implications  of  the  study, 


CHAPTER  II 
REVIEW  OF  LITERATURE 


Donabedian  (1980)  articulated  the  rationale  for  making 
subjective  assessments  of  patient  satisfaction.  He 
identified  patient  satisfaction  as  a factor  directly 
influencing  compliance  with  medical  regimes  and  decisions 
regarding  access  to  care. 

Even  though  investigators  frequently  measure  satisfac 
with  medical  care  in  health  service  settings,  their  reasons 
for  making  these  assessments  vary  considerably.  The  focus 
of  patient  satisfaction  measurement  depends  upon  (a)  the 
goals  of  the  institution  conducting  the  assessment,  (b)  the 
information  needs  of  the  institution,  (c)  the  setting  in 
which  the  care  is  delivered,  and  (d)  the  variety  of  health 


The  varying  needs  of  health  care  fs 
for  patient  satisfaction  information  hav 
development  of  a number  of  methods  for  ir 
care.  Medical  and  nursing  audits,  peer 
surveys,  and  quality  assurance  programs 
aspects  of  the  care  delivered  by  health 
According  to  Zastowny,  Roghmann,  an 
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scientific  management  of  disease,  using  a more  humane 
approach  to  health  care  may  be  more  productive  in  terms 
of  achieving  or  maintaining  health  status.  Patient 
attitudes  about  health  care  provide  medical  care 
professionals  and  administrators  with  valuable  information 
complementing  technical  assessments  of  quality  of  care. 

surveys,  patient  satisfaction  research  has  progressed  slowly 
for  several  reasons.  Two  basic  problems  have  plagued 
satisfaction  investigators:  (a)  which  data  to  collect,  and 

(b)  how  to  use  the  information  once  collected,  additionally, 
the  widening  conceptualisations  of  patient  satisfaction  have 
resulted  in  differing  needs  of  administrators  for  patient 
satisfaction  data.  Since  satisfaction  mirrors  the 
experience  of  a specific  group  of  patients  using  a specific 
health  care  situation  at  a given  time,  the  structure  of  the 
satisfaction  assessment  instrument  should  reflect  those 
unique  experiences.  Mixing  and  comparing  patient  populations 
that  have  different  experiences  are  inappropriate  strategies 
when  the  purpose  of  patient  satisfaction  research  is  problem 
identification  (Zastowny  et  al.,  1983).  The  following 
three  examples  demonstrate  the  inappropriateness  of  comparing 
populations  with  different  health  care  experiences  and 

to  create  facility-specific  instruments. 

The  assessment  of  satisfaction  with  health  care  in 
long-term  care  facilities  often  focuses  on  quality-of-life 
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in  a health  care  facility,  factors  such  as  food,  noise  le 
comfort,  and  cleanliness  of  surroundings  become  major 
components  of  satisfaction  with  care  (O'Sullivan,  1983). 

In  acute  care  facilities,  patients  often  cite 
amenities  as  being  important  aspects  of  satisfaction  with 
care.  Even  though  patients  should  be  made  as  comfortable 
as  possible,  an  argument  can  be  made  that  focusing  on 
amenities  is  not  an  effective  way  to  evaluate  quality  of 
health  care.  Since  patients  admitted  to  acute  care 
facilities  are  often  seriously  ill  and  may  be  candidates 
for  surgery,  assessment  of  satisfaction  sometimes  focuses 
on  patients'  reactions  to  technical  aspects  of  quality  of 
care  (O'Sullivan,  1983). 

Satisfaction  with  ambulatory  care,  which  has  been 
shown  to  have  a significant  impact  on  patient  compliance 
with  prescribed  treatment  regimes  (Becker,  Drachman,  s 
Kirsch,  1974;  Freidson,  1961)  and  willingness  to  return  to 
the  ambulatory  care  setting  (Gabrielson,  Levin,  & Ellison. 
1967)  is  strongly  influenced  by  accessibility  (Osterweis  s 
Howell,  1979),  staff  courtesy  (Francis,  Korsch,  & Morris, 
1969;  King  & Goldman,  1975)  and  waiting  time  (King  s 
Goldman,  1975;  Lebow,  1974). 

Problems  associated  with  deciding  which  data  to  colie 
and  how  to  use  them,  coupled  with  the  need  for  inhouse 
replications  of  patient  satisfaction  studies,  are  not  the 
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only  situations  hampering  the  progress  of  patient 
satisfaction  research.  Ware,  Davies-Avery , and  Stewart 
(1978)  identified  another  problem  with  assessments  of 
patient  satisfaction.  They  cited  methodological 
shortcomings  focusing  on  the  failure  of  investigators  to 
adequately  assess  the  validity  and  reliability  of  patient 
satisfaction  assessment  instruments  in  most  of  the 
patient  satisfaction  research  they  reviewed.  They  concluded 
that  the  full  potential  of  such  surveys  will  not  be 
realized  until  scientists  can  measure  satisfaction  with 
acceptable  levels  of  validity  and  reliability. 

The  literature  review  contains  findings  from  patient 
satisfaction  research  conducted  in  a variety  of  health  care 
settings.  Even  though  the  investigators  cited  in  the 
following  pages  explored  user  satisfaction  in  diverse 
settings,  knowledge  of  their  procedures,  findings,  and 
recommendations  yields  valuable  information  for  the  design 
of  this  and  subsequent  studies. 


through 


service  delivery  and  at  a later  time;  and  (d)  to  compare 
the  level  of  user  satisfaction  at  time  of  service  delivery 
and  at  a later  time,  as  steps  toward  developing  a model  for 

The  research  cited  in  the  preceding  section  of  the 
review  of  literature  related  to  the  need  for  patient 
satisfaction  investigators  (a)  to  develop  health  care 
facility-specific  instruments  for  assessing  patient 
satisfaction  and  (b)  to  cyclically  replicate  and  improve 
their  instruments  and  research  methodologies. 

The  research  cited  in  the  following  section  pertains 

instruments  and  the  assessment  of  these  instruments  in 
terras  of  their  reliability  and  validity. 

Development  of  Satisfaction  Scales 

Much  early  patient  satisfaction  research  relied  on 
broad,  general  questions  for  collecting  data.  Early 
satisfaction  investigators  used  single-item  questions  and 
captured  global  measures  of  satisfaction  with  health  care 
(Francis  et  al.,  1969;  Wooley,  Kane,  Hughes,  S Wright, 

1973) . To  health  care  administrators,  the  non-specific, 
qualitative  information  gathered  was  of  limited  value  for 
identifying  problems  in  health  care  facilities  and  for 
determining  strategies  for  improving  health  care  delivery. 
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Efforts  to  formalize  multidimensional  measures  of 
patient  attitudes  about  health  care  appeared  in  the 
literature  of  the  late  1960s  and  early  1970s.  In  this 
second  line  of  research,  investigators  used  multiple-item 
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negative  attitudes, 
rovide  an  unbiased, 
vel  of  satisfaction  or 
each  respondent  (Hulka  et  al.,  1970). 
rale  of  Hulka  et  al.  (1970)  was 
Thurstone  Method  of  Equal-Appearing 
to  identify  items  to  be  included  in  the 
snsions  (domains)  of  patient  satisfactia 
(a)  patients'  views  of  the  professional  competence  of  the 
physician;  (b)  patients'  perceptions  of  their  personal 
relationship  with  the  physician;  and  (c)  patients’  views  of 

The  researchers  also  investigated  the  relationship  of 


The  attitude 
developed  using  th 


following  thre 


demographic  var 
of  the  attitude  scale  in  a community  health  care  setting. 

The  Thurstone  Method  required  the  development  of  a 
large  number  of  statements  thought  to  express  varying 
degrees  of  favorableness  or  unfavorableness  toward  medical 
care.  The  statements  were  then  submitted  to  three  panels 
of  expert  judges  who  rated  each  statement  on  a continuum 
ranging  from  extremely  favorable  to  extremely  unfavorable. 
Each  statement  was  given  a median  score  and  an  estimate 
of  variance  dependent  on  the  degree  of  consensus  among 
the  judges.  Those  statements  which  lay  at  equidistant 
points  along  the  scale  (index)  and  exhibited  high  consenses 


reliability  of  the  scale.  Respondents  were  given  one  oi 
the  other  of  the  dichotomously-scored,  parallel  forms  of 
the  instrument.  Each  parallel  form  contained  12  to  14 
statements  on  each  of  the  three  domains  of  satisfaction 
identified  (professional  competence,  personal  qualities, 
and  cost/convenience  items).  Respondents  were  given 
written  instructions  requesting  them  to  agree  or  disagre 
with  each  statement  on  the  instrument.  Even  though 
patients  completing  this  instrument  still  responded  in 
terms  of  being  satisfied  or  dissatisfied  with  health  car 
the  scale  allowed  respondents  to  dichotomously  rate  nume 


health 


al.,  1970) 


The  following  year,  Hulka,  Zyzanski,  Cassel,  and 
Thompson  (1971)  tested  the  scale  in  a household  survey  in 
a low-income  area  of  North  Carolina.  And  later,  Hulka, 

Kupper,  Daly,  Cassel,  and  Schoen  (1975)  reported  a third 
administration  of  the  satisfaction  scale  as  revised  by 
Zyzanski,  Hulka,  and  Cassel  (1974).  The  ultimate  objective 
of  this  replication  of  research  was  to  develop  a usable 
instrument  for  measuring  patient  attitudes  about  medical 
care  in  a community  primary-care  setting.  The  data-collection 
instrument  included  the  satisfaction  scale  as  well  as  questions 
requesting  demographic  data  about  respondents.  With  these 
data,  the  investigators  could  determine  the  relationship 
between  expressed  levels  of  satisfaction  and  demographic 
the  statistical  analyses  of 
s of  the  scale,  the  investigators 


variables.  In  pc 
these  four  admin; 


focused  or 
the  scale. 


The  research  of  Hulka  et  al.  (1970,  1971,  1975) 
snfirmed  the  hypothesis  that  patient  attitudes  towarc 
le  different  domains  or  subscales  of  satisfaction  wit 
salth  care  varied  considerably.  Several  characterist 
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levels  of  satisfaction  with  professional  competence  were 
associated  with  higher  educational  and  occupational  levels. 
Having  hospital  insurance,  a regular  physician,  and  a recent 


physician  visit  were  correlated  with  higher,  cumulative 


less  satisfied  with  the  costs  and  convenience  of  care  than 
with  physicians'  professional  competence  or  physicians' 
personal  qualities  exhibited  during  health  care  encounters 
(Hulka  et  al.,  1975). 

In  the  replicative  study  mentioned  earlier  in  this 
section,  Zyzanski  et  al.  (1974)  modified  the  content,  format, 
and  scoring  method  of  the  satisfaction  scale  developed  by 
Hulka  et  al.  (1971).  They  wrote  the  items  in  a Likert 
format,  providing  a range  of  five  response  options  from 
strongly  agree  to  strongly  disagree.  The  Likert  format 
allowed  for  greater  discrimination  of  the  intensity  of  a 
respondent's  belief  regarding  an  issue.  The  Likert  format 


ana  use  of  scale  product  method  produced  scores  consistently 
more  reliable  than  scores  computed  using  the  Thurstone 
Method.  Internal  consistency  reliability  estimates  for 
the  scale  product  scoring  method  used  in  this  study  were 
personal  qualities  of  physicians,  .75,-  professional 
competence  of  physicians,  .86;  and  cost/convenience  of 
care,  .68  (using  a 95*  confidence  level). 

Even  though  the  analysis  of  validity  of  the 
satisfaction  scale  developed  by  Hulka  et  al.  (1975)  was 
restricted  to  estimates  of  face  validity,  this  research 
established  the  credibility  of  assessing  satisfaction  with 
health  care  using  a multi-faceted  scale.  Values  given  to 
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patient  satisfaction  component  score  or  index.  The 
satisfaction  index  expresses  the  respondent's  general  level 
of  satisfaction  with  health  care.  This  methodology  enabled 
researchers  to  determine  if  groups  of  respondents  differed 


Validity  and  Reliability  of  Satisfaction  Scales 

Other  investigators  interested  in  patient  satisfaction 
then  turned  to  more  rigorous  measures  of  the  validity  of 
satisfaction  scales.  Some  researchers  analyzed  the  validity 
of  the  scale  more  extensively  than  Hulka  and  her  colleagues 
by  including  in  their  data  evaluation  factor-analysis 
procedures  and  measures  of  unidimensionality  of  the  three 
domains  of  the  scale  developed  by  Hulka  et  al.  (1975).  An 
examination  of  the  work  of  these  investigators  follows  a 
discussion  of  item  and  factor  analyses. 

In  assessing  the  content  validity  of  a scale,  item 
and  factor  analysis  determine  if  respondents  react  to 

then  that  trait  should  cause  the  items  to  covary.  The 
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average  correlations  if  the  items  have  been  properly 
clustered  into  domains  of  a concept  such  as  patient 

The  more  closely  related  the  items  within  clusters 
(domains) , the  more  likely  (a)  the  correlations  between 
related  items  will  predict  the  direction  of  a response  on 
a given  item,  and  (b)  the  cluster  is  measuring  only  one 
aspect  of  the  concept  of  interest.  When  a cluster  of 

unidimensional.  Items  showing  highest  correlation  with 
each  other  will  also  show  the  highest  correlation  with 
a total  scale  score  or  index  that  is  based  on  the  summation 


Ware  and  Snyder  (1975)  made  a more  extensive  attempt 
to  document  the  use  of  factor  analysis  in  assessing  items 
for  a patient  satisfaction  scale.  They  combined  70  items 


scores.  Their  domains  of  satisfaction  included  access  to 
care,  continuity  of  care,  availability  of  services,  and 
physician  conduct.  Internal  consistency  reliability 
coefficients  of  the  four  total  subscales  ranged  from  .66 
to  .89.  In  later  studies  using  this  scale  Counte  (1979), 
Hengst  and  Roghmann  (1978) , and  Stewart  and  Wanklin  (1979) 
reported  results  similar  to  those  of  Hulka  and  her  colleagi 
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Mangelsdorff  (1979)  surveyed  a military  population  to 
test  a 19-item  patient  satisfaction  scale.  The  final  version 
of  the  questionnaire  contained  three  components  or  subscales: 
physicians'  interactions,  nonphysicians ' interactions,  and 
ancillary  services  provided.  Factor  analysis  produced 
reliability  coefficients  for  the  three  derived  domains  that 
ranged  from  .87  to  .93.  These  three  domains  accounted  for 
67%  of  the  variation  in  patients'  ratings  of  satisfaction 
(Mangelsdorff,  1979) . 

Stamps  and  Finkelstein  (1978)  recognized  the  importance 
of  the  work  of  Ware  and  Snyder  (1975)  but  pointed  out  a 
major  flaw  in  their  work.  By  combining  items  from  several 
attitude  scales,  researchers  jeopardized  the  integrity  of 
the  individual  scales.  This  criticism  reiterated  the  need 
for  scales  reflecting  the  unique  experiences  of  particular 
groups  of  health  care  consumers  in  particular  health  care 
settings. 

Stamps  and  Finkelstein  (1978)  reported  on  three 
additional  administrations  of  the  satisfaction  scale  Hulka 
and  her  colleagues  had  developed  and  written  about  in  1975. 
Stamps  and  Finkelstein  used  extensive  statistical  analyses 
to  produce  measures  of  both  validity  and  reliability  of 
the  scale.  Their  goal  was  to  determine  the  unidimensionality 
of  each  of  the  three  domains  or  subscales  of  satisfaction 


id  Snyder  (1975)  had  repot 


A brief  description  of  the  other  statistical  procedures 
Stamps  and  Finkelstein  (1978)  used  follows. 

Stamps  and  Finkelstein  (1978)  used  the  Guttman 
technique  of  scalogram  analysis.  This  stringent  test  for 
unidimensionality  yields  a coefficient  of  reproducibility 
which  is  an  estimate  of  the  probability  of  the  scale 
measuring  one  concept.  The  appropriate  level  for  acceptance 
as  determined  by  Guttman  was  a coefficient  of  reproducibility 
of  .85  at  a 95%  level  of  confidence  (Mason  & Bramble,  1978). 

A second  component  of  the  Guttman  scalogram  model, 
the  coefficient  of  scaleability,  tests  one  of  the  major 
assumptions  of  the  Guttman  model,  that  of  whether  the  scale 
is  cumulative.  The  appropriate  level  for  acceptance  as 
Guttman  determined  it  is  a coefficient  of  scaleability 
of  .50. 

The  results  and  conclusions  of  the  analyses  by  Stamps 
and  Finkelstein  did  not  support  the  existence  of  three 
independent  domains  within  the  satisfaction  index.  In 
the  third  administration  of  the  scale  by  Ware  and  Snyder  (1975) 
item  analysis  by  Stamps  and  Finkelstein  demonstrated  that 
few  items  on  each  subscale  (domain)  of  satisfaction  were 
related  with  the  exception  of  the  professional  competence 
subscale.  Also,  only  on  the  third  administration  of  the 
scale  (Hulka  et  al.,  1975)  did  the  Guttman  scalogram 
analysis  produce  a coefficient  of  reproducibility  equal 
to  .90  and  a coefficient  of  scaleability  equal  to  .50. 


The  results  of 


factor  analysis  by  Stamps  and 


Finkelstein  (1978)  of  the  third  administration  of  the  scale 
by  Hulka  et  al.  (1975)  indicated  that  the  attitude  scale 
was  composed  of  four  domains  or  subscales  of  satisfaction 
with  one  of  them  accounting  for  61%  of  the  variance  in 
attitudes.  The  best  results  occurred  in  a much  more 
limited  research  setting  than  the  originators  of  the  scale 
had  hoped— that  is,  with  patients  who  were  interviewed  as 


they  waited  to  receive  medical  care. 

Validity  implies  that  one  can  obtain  a reasonably 
unbiased  estimate  of  that  which  one  claims  to  measure.  The 
analysis  by  Stamps  and  Finkelstein  disclosed  the  degree  to 
which  each  of  the  three  subscales  was  unidimensional. 

Hulka  and  Zyzanski  (1982)  defended  the  original  scale  by 
raising  two  important  questions:  Is  unidimensionality  the 

most  accurate  indicator  of  validity?  Are  the  three 
analytic  strategies  used  by  Stamps  and  Finkelstein 
appropriate  in  terms  of  the  design  and  intended  use  of 


individt 


psychological  characteristics 


administration.  Hulka  and  Zyzanski  (1982)  proposed  that 
validation  of  patient  attitude  scales  be  based  on  a more 
generous  conceptualization  of  their  content  and  some 
consideration  of  their  purpose  and  use. 

Responses  to  the  items  within  a given  subscale  or 
domain  should  be  such  that  the  items  cluster,  as  evidenced 
by  the  correlation  coefficients  in  an  item  analysis.  But 
satisfaction  investigators  still  face  questions  concerning 
how  large  these  coefficients  should  be.  If  they  are  too 
high  (.80  or  above),  one  may  argue  that  some  of  the  items 
are  redundant.  On  the  other  hand,  a low  coefficient 
indicates  that  a particular  item  is  not  conforming  to  the 
response  pattern  of  the  whole  set  of  items.  Low  correlation 
coefficients  may  indicate  that  such  items  are  irrelevant, 
inappropriate,  or  misunderstood  by  respondents.  According 
to  Ware  (1981) , items  that  belong  in  the  scale  will  correlate 
substantially  (.40  or  higher)  with  each  other  (a  test  for 
item  homogeneity)  and  with  the  same  subscale  or  domain. 

Hulka  and  Zyzanski  (1982)  also  questioned  use  of  the 
Guttman  Scalogram  method  in  patient  satisfaction  research. 
These  researchers  felt  that  Guttman  scaling  is  not  relevant 
when  individual  items  cover  a broad  range  of  subject  matter. 
Personal  experience  will  alter  attitudes  toward  the  subject 
items  more  than  others.  Analytic 


ssed  in  some 


study  of  abstract 


be  inappropriately  interpreted  when  they  are  applied  to 
scales  that  reflect  a large  experiential  component  (Hulka  a 
Zyzanski,  1982) . 


According  to  Hulka  and  Zyzanski  (1982),  factor  analysis 
may  also  be  an  inappropriate  validity  measure  in  patient 
satisfaction  research.  Pactor  analysis  may  not  be  successful 
in  developing  components  of  a patient  satisfaction  scale. 
Again,  these  researchers  reiterated  the  thought  that  specific 
needs  for  specific  satisfaction  data  may  outweigh  the 
results  of  analysis  techniques  that  may  be  inappropriate 
for  evaluating  the  measurement  of  concepts  that  are  so 
heavily  influenced  by  the  experiences  of  respondents. 

In  his  study  of  acquiescence  response  set.  Ware  (1978) 
documented  the  tendency  of  respondents  to  agree  with  all 


items,  whether  positive  or  negative  in  affect.  The 
agreement  of  respondents  may  be  so  great  as  to  account  f< 
25%  of  the  variation  in  the  interitem  correlation  matrici 
The  distortion  in  responses  resulting  from  acquiescence 
response  set  will  confuse  results  of  factor  analysis  and 


decrease  interpretability. 

According  to  Ware  (1978) , validation  of  instrument 
designed  for  measuring  attitudes  toward  complex  subject 
such  as  health  care  delivery  is  not  a purely  technical 
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understood.  Measured  attitudes  are  influenced  by  personal 
experiences  of  respondents  and  circumstances  surrounding 
administration  of  the  scale  (Ware,  1978) . The  most 
important  test  of  the  validity  of  a scale  may  be  its 
utility — the  extent  to  which  it  serves  the  intended  purpose. 

In  an  article  defining  the  dimensions  of  patient 
satisfaction,  Ware  (1981)  defined  five  major  dimensions  of 
satisfaction.  These  dimensions  (domains)  of  satisfaction 
were  determined  by  content  analysis  procedures  conducted  by 
Ware,  Snyder,  and  Wright  (1976)  of  published  satisfaction 
instruments.  Ware  (1981)  described  the  dimensions  as 
follows. 


Quality  of  care.  The  most  frequently  measured 
dimension  of  satisfaction  pertains  to  the  amount  of  caring 
(art  of  care)  shown  toward  patients,  the  competence  of 
providers  (technical  aspects  of  care) , and  outcomes  of  care, 
measured  in  terms  of  perceptions  regarding  the  usefulness 
or  helpfulness  of  medical  care  providers  and  specific 
treatments  in  improving  or  maintaining  health  status  of 


Accessibility/convenience  of  health  care.  This 
dimension  includes  all  factors  involved  in  arranging  to 
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Physical  environment.  Sources  of  satisfaction  with 
the  environment  of  care  include  general  pleasantness  of 
the  atmosphere,  attractiveness  of  waiting  rooms,  comfort, 
clarity  of  signs  and  directions,  lighting,  cleanliness, 
and  the  orderliness  of  facilities  and  equipment. 

Availability  of  health  care.  Measures  of  this 
dimension  usually  focus  on  whether  enough  clinics  and 
hospitals  are  available  in  an  area,  and  whether  these 
facilities  are  staffed  with  enough  health  care  providers. 

investigators.  Ware  (1981)  advised  that  not  all  surveys 
need  to  include  each  of  the  five  dimensions  described  above. 
When  interest  is  on  satisfaction  constructs  that  existing 
instruments  do  not  assess,  the  investigator  can  include 
and  test  these  items  for  reliability  and  item  discriminant 

The  studies  described  in  the  preceding  pages  are 
representative  of  patient  satisfaction  research  focusing 
on  the  reliability  and  validity  of  attitude  scales. 


of  instruments  for  assessing  patients'  attitudes  about 
health  care  and  are  analyzing  the  results  more 
when  reliability  and  validity  of  the  assessment 


stringently 


Survey  administration  procedures  are  as  unique  a 
the  facilities  in  which  researchers  assess  patient 
satisfaction.  Hulka  and  her  colleagues  (1970,  1971, 
Ware  and  Snyder  (1975),  and  Counte  (1979)  relied  on  i 
in  the  homes  of  patients.  In  two  general  medical 
university  hospital  outpatient  clinics,  Comstock,  Hoo 
Goodwin,  and  Goodwin  (1982)  and  Nelson-Wernick  et  al. 
relied  on  self-administered  questionnaires  completed 
on-site  for  collection  of  satisfaction  data.  Carey  a 
Posavac  (1982)  surveyed  by  mail  inpatients  who  had  be 


In  college  student  health  service  settings,  Gillette, 
Byrne,  and  Cranston  (1982)  and  Liao  et  al.  (1978)  examined 
usage  and  satisfaction  by  analyzing  data  they  collected  fro 
mailed  surveys  and  McDaniel  (1979)  collected  satisfaction 
surveys  focusing  on  usage  and  satisfaction  on  the  campus 
of  the  student  health  service  of  their  interest  but  in 
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medical  units  of  a teaching  hospital,  Helson-Wernick  et  al. 
(1981)  used  survey  representatives  to  facilitate  collection 
of  completed  surveys  from  patients  (at  the  time  of  their 

questionnaire  representatives  took  the  survey  to  the  room 
of  the  patients,  explained  the  nature  of  the  project, 
ensured  the  confidentiality  of  responses,  and  remained  in 

the  presence  of  the  survey  representatives  did  not  appear 
to  bias  responses  and  contributed  to  the  size  of  the  study 
sample.  The  investigators  used  a stratified  random 
sampling  technique  for  selecting  a representative  number 
of  patients  from  each  unit  on  a given  floor.  Even  though 
the  subject  hospital  in  this  study  averaged  20,000 
admissions  per  year  with  average  stays  of  7 days,  the 
researchers  felt  that  this  study  group  of  167  respondents 
was  adequate  for  satisfaction  assessment. 

Morrison  et  al.  (1982)  conducted  a study  in  a 
teaching  hospital  serving  35,000  inpatients  per  year, 
surveying  inpatients  on-site  during  a 6 -week  data 
collection  period.  The  investigators  determined  the  study 
group  size  by  their  desire  to  increase  the  10%  return  rate 
of  questionnaires  administered  the  previous  year.  They 
believed  that  the  re 
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The  size  of  the  study  groups  investigators  have 
examined  in  patient  satisfaction  research  were  somewhat 
determined  by  the  methods  of  data  collection  and  the  methods 
of  selecting  study  participants.  Sample  size  ranged  from 
20  respondents  (Taylor,  Nelson-Wer nick , Currey,  Woodbury, 
and  Conley,  1981)  to  3,287  respondents  (Mangelsdorff , 1979). 
After  reviewing  numerous  satisfaction  studies,  I concluded 
that  the  range  of  sample  sizes  in  studies  conducted  in 
other  ambulatory  health  care  facilities  similar  to  the 
subject  student  health  service  appeared  to  be  100  to  500 
participants. 

According  to  Bailey  (1982) , in  order  to  have  a minimum 
number  of  subjects  for  analyzing  all  combinations  of  groups 
or  variables  of  interest,  one  must  have  at  least  the  minimum 
sample  size  needed  to  represent  accurately  the  population 
from  which  one  is  sampling.  The  failure  of  a sample  to 
adequately  represent  its  population  is  referred  to  as 
sampling  error.  Use  of  nonprobability  sampling  provides 
no  basis  for  estimating  sampling  error,  further  complicating 
the  decision  about  sample  size. 

Even  though  many  researchers  consider  30  subjects  to 
be  a bare  minimum,  Bailey  (1982)  considered  100  respondents 
a more  reasonable  minimum.  Since  the 


sampling  frame 


health  service 
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subject  study  (all  users  of  one  student 
during  1984)  was  unknown,  a minimum  sample  size  cannot  be 
determined  for  this  nonprobability  sample  (the  study 
group) . In  such  cases,  researchers  attempt  to  collect 
data  from  a study  group  large  enough  to  allow  for  the 
analysis  of  information  from  subgroups  of  interest  in  the 
study. 

from  one  health  care  facility  to  another,  depending  on 
the  unique  information  needs  of  the  facility  staff.  In 
the  field,  patient  satisfaction  researchers  often  focus  on 
gathering  satisfaction  data  to  improve  health  care.  If 
investigators  base  methodologies  for  assessing  patients' 
attitudes  on  findings  of  current  research  in  that  area, 
they  can  draw  sound  conclusions  on  several  aspects  of 
patient  satisfaction. 

Research  Relating  to  the  Secondary  Purpose  of  This  Study 
A secondary  purpose  of  this  study  was  (a)  to  group  and 
compare  survey  participants  by  their  self-reported  responses 
to  demographic  and  usage  questions  contained  in  the 
respondent-reported  data  section  of  the  questionnaire,  (b) 
to  compare  these  groups  and  their  mean  levels  of 
satisfaction  with  the  subject  student  health  service,  as 
measured  by  the  Patient  Satisfaction  Index,  and  (c)  to 
provide  administrators  of  the  subject  student  health  service 


with  data  organized  to  reflect  differences  in  the 
satisfaction  of  groups  of  users  categorized  by  their 
self-reported  characteristics  in  order  to  facilitate  the 
identification  of  problematic  aspects  of  health  care 
provision. 

The  research  that  is  cited  in  the  following  section 
pertains  to  the  secondary  purpose  (Purpose  2)  of  this 
study — design  of  the  instrument  so  that  grouping  and 
comparison  of  users  on  their  mean  levels  of  satisfaction 
can  be  accomplished  to  facilitate  the  identification  of 
factors  associated  with  dissatisfaction  with  health  care 
provision  in  the  subject  student  health  service.  In 
designing  the  Patient  Satisfaction  Questionnaire  for  this 

instrument  previously  developed  for  use  in  the  subject 

items,  were  based  upon  the  findings  of  patient  satisfaction 
research  cited  previously  in  this  review  of  literature 


Counte  (1979)  assessed  the  convergent  validity  of 
three  types  of  measurement  items  commonly  used  in  patient 
satisfaction  survey  questionnaires.  Respondents  in  this 
study  were  outpatients  in  a comprehensive  multiple 
sclerosis  treatment  center.  The  investigators  constructed 
measurement  items  to  be  (a)  global  measures  for  rating 
overall  health  care  received,  (b)  Likert  scale  measures 
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offering  a range  of  response  choices  for  agreeing  or 
disagreeing  with  statements  about  health  care  received, 
or  (c)  semantic  differential  measures  that  indirectly 
assess  respondents'  attitudes  by  having  them  react  to 
bipolar  statements  about  health  care  received. 

The  investigator  found  that  all  three  types  of 
measurement  items  were  measuring  the  same  construct 
(satisfaction  with  health  care  received)  but  two  types  of 
items  were  more  closely  related  (global  and  semantic 
differential)  than  either  was  to  the  third  type  (Likert 
scale) . Results  of  this  study  suggest  that  measurement 
bias  may  limit  the  comparability  of  patient  satisfaction 
study  findings  that  were  based  on  different  types  of 

In  this  study  Counte  (1979)  supported  the  use  of  the 
Likert  scale  format  of  the  patient  satisfaction  data  section 
items  that  were  the  components  of  the  Patient  Satisfaction 


Osterweis  and  Howell  (1979)  developed  and  administered 
a patient  satisfaction  survey  at  three  ambulatory  care  sites 


would  yield  comparable  results  when  the  investigat 
administered  them  by  mail,  by  telephone,  or  on-sit 


Site  1 was  a developing  health  maintenance  organization 
(HMO)  located  outside  Washington,  D.C.  Site  2 was  a prepaid 
group  practice  in  Washington,  D.C.  Site  3 was  a medical 
school-based,  fee-for-service,  adult  clinic  serving  inner-city 
residents.  Investigators  collected  attitudinal  data  for 
patients  at  the  three  centers  through  the  use  of  questionnaires 
composed  primarily  of  fixed-alternative  questions. 

Given  the  time,  expense,  and  personnel  necessary  to 
administer  questionnaires  by  mail  and  telephone,  the 
investigators  concluded  that  on-site  questionnaire 
administrations  are  adequate  for  most  purposes.  Return 
rates  for  questionnaires  were  as  follows:  38%  of  mailed 

surveys,  46%  of  telephone  surveys,  and  54%  of  surveys 
administered  on-site.  The  areas  of  dissatisfaction  remained 
essentially  unchanged  regardless  of  how  investigators 
administered  questionnaires.  This  study  supported  the 

administration  of  questionnaires. 

Osterweis  and  Howell  (1979)  concluded  that  because 
the  amount  of  dissatisfaction  expressed  on-site  may  be 
somewhat  lower  than  revealed  by  mail  or  telephone  surveys, 
health  care  administrators  should  view  even  a relatively 
small  percentage  of  dissatisfied  patients  as  a threshold 
indicating  the  need  for  future  evaluation  and  corrective 


1.  Personal  interest  and  competence  of  health  care 

2.  The  amount  of  information  provided  to  patients  on 
health  problems, 

3.  Convenience  and  ease  of  access  to  care,  and 

4.  Cost  of  health  care. 

Factors  1 and  2 above  supported  the  inclusion  of  items 
1 through  6 in  the  patient  satisfaction  data  section  of  the 
1984  Patient  Satisfaction  Questionnaire.  Factors  3 and  4 
above  supported  the  inclusion  of  items  7 and  9 in  the 

The  questionnaire  included  an  open-ended  question 
asking  respondents  the  reasons  for  their  overall  satisfaction 
or  dissatisfaction  with  the  health  care  they  received. 
Respondents  from  site  1 focused  on  technical  competence 
of  health  care  providers,  while  site  3 respondents  focused 
on  human  elements  of  care.  Site  2 respondents  were  mixed 
in  their  responses. 


Based  on  the  results  of  this  open-ended  question 
included  in  the  questionnaire,  the  investigators  concluded 
that  different  populations  have  different  expectations 
about  their  health  care,  and  their  judgments  about  quality 
of  care  depend  on  whether  these  expectations  are  or  are 
not  met.  Investigators  performing  patient  attitude  studies 
normally  proceed  with  the  assumption  that  all  patients  want 
and  expect  the  same  from  their  health  care  providers.  If 


satisfaction  investigators  would  be  wise  to  determine  what 
their  patients  consider  to  be  the  keys  to  acceptable  health 
care  (Osterweis  & Howell,  1979) . 

This  study  by  Osterweis  and  Howell  (1979)  supported 
the  retention  of  the  open-ended  comments  question  on  the 

respondent-reported  data  section  of  the  questionnaire. 

Nelson-Wernick  et  al.  (1981)  surveyed  patient  perceptions 
of  care  during  hospitalization  in  a study  in  a medical 
university  hospital.  They  randomly  selected  inpatients 
who  had  been  hospitalized  for  at  least  3 days.  The 
investigators  found  that  patients  previously  admitted  to 
the  medical  university  hospital  rated  the  hospital  higher 
than  first-time  patients  of  the  university  hospital, 
suggesting  that  some  learning  occurred  during  hospitalization. 
Patients  who  are  more  familiar  with  a particular  hospital 
may  perceive  it  in  a more  favorable  way.  An  alternative 
explanation  may  be  that  patients  familiar  with  a particular 
hospital  may  be  more  cooperative  and  somehow  assist  the  staff 
in  providing  services  to  them  (Nelson-Wernick  et  al. , 1981). 

To  examine  the  impact  of  familiarity  with  the  subject 
student  health  service,  item  B in  the  respondent-reported 
data  section  of  the  questionnaire  was  revised,  item  C was 
retained  from  the  previous  instrument,  and  item  D was  added 
asking.  Did  you  have  an  appointment  for  this  visit? 


In  a study  conducted  in  a general  medicine  outpatient 
clinic  at  a state  university  hospital,  Comstock,  Hooper, 
Goodwin,  and  Goodwin  (1982)  assessed  patient  satisfaction 
on  an  8-item,  Likert  scale  format  questionnaire  and  with 
ratings  of  a trained  observer  on  26  verbal  and  nonverbal 
skills  reflecting  caring  behaviors  physicians  exhibited. 

The  researchers  grouped  caring  behaviors  under  five 
categories:  information-giving,  listening,  empathy,  nonverbal 

gestures  or  physical  attention,  and  courtesy  skills. 

These  investigators  found  that  patient  satisfaction 
correlated  strongly  with  ratings  for  physician  courtesy 
and  information-giving,  other  interesting  findings  of 
this  study  were  that  the  investigators  found  no  significant 
correlation  between  a physician's  appearance,  the  physician's 

spent  per  client,  and  the  degree  of  satisfaction  of  patients 
seeing  that  physician  (Comstock  et  al.,  1982). 

The  investigators  felt  that  these  findings  were 
particularly  important  in  terms  of  compliance  with  medical 
treatments.  Stiles,  Putnam,  Wolf,  and  James  (1979)  found 
that  the  greater  the  friendliness  and  solidarity  the 
physician  expressed,  the  more  satisfied  and  compliant  the 
patient.  Findings  of  Ben-Sira  (1976) , Larsen  and  Rootman 
(1976),  and  Stiles  et  al.  (1979)  support  the  conclusion 
of  Comstock  et  al.  (1982)  that  information-giving  by  the 
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physician  and  the  quality  of  physician-patient  communication 
correlated  positively  with  patient  satisfaction. 

The  research  cited  in  the  preceding  paragraph  further 
supported  the  inclusion  of  items  1,  2,  and  3 in  the  patient 
satisfaction  data  section  of  the  questionnaire.  The  items 
represented  the  personal  qualities  of  the  health  care 
provider  domain  of  patient  satisfaction. 

In  a patient  satisfaction  study,  Gillette  et  al.  (1982) 
mailed  a 40-item  survey  questionnaire  to  a random  sample 
of  500  students  using  a state  university  student  health 
service  during  the  S-week  study  period.  They  found  that 
(a)  patient  satisfaction  correlated  significantly  with 
perceived  technical  competence  of  the  health  practitioner 
and  perceived  adequacy  of  interpersonal  aspects  of  the 
practitioner-patient  relationship;  (b)  a significant 
relationship  did  not  exist  between  satisfaction  and 
expectations  the  patients  held  of  the  practitioner's 
role  performance;  (c)  time  waited  during  medical  care 
encounters  was  inversely  related  to  satisfaction;  (d) 
a significant  relationship  existed  between  health  information/ 
education  related  to  diagnoses,  prognoses,  and  treatment 
plans  and  satisfaction;  and  (e)  perceived  technical 
competence  of  the  practitioner  and  the  adequacy  of  the 
interpersonal  relationship  between  patient  and  practitioner 
were  the  two  most  important  variables  influencing  patient 
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This  study  supported  the  inclusion  of  items  1 through 
6-  and  8 in  the  patient  satisfaction  data  section  of  the 
questionnaire  and  items  E and  H in  the  respondent-reported 
data  section  of  the  questionnaire. 

Gillette  et  al.  (1982)  also  found  that  younger  (18-to- 
19-year-old)  students  seemed  somewhat  less  satisfied  than 
older  students.  This  finding  may  suggest  that  younger 
students  are  not  familiar  with  the  student  health  service 
system  of  health  care.  On  the  basis  of  this  finding  and 
findings  of  past  survey  administrations  in  the  subject 
facility,  item  A in  the  respondent-reported  data  section 
of  the  questionnaire  was  retained  from  the  previous 


Liao  et  al.  (1978)  studied  graduate  student  use  of  a 
student  health  service  at  a large,  southern  university. 
Results  of  this  study  indicated  that  a lack  of  information 
on  available  services  and  access  to  local  health  care 
provided  a barrier  to  access  for  many  graduate  students. 
Affordability  and  availability  were  most  frequently  cited 
by  graduate  students  as  barriers  to  access.  This  study 
supported  the  inclusion  of  item  7 in  the  patient 
satisfaction  data  section  of  the  1984  Patient  Satisfaction 
Questionnaire. 

McDaniel  (1979)  initiated  a study  in  a large  southern 
university  student  health  service  in  response  to  complaints 
about  a staff  physician.  In  this  problem-centered  patient 
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satisfaction  assessment,  the  investigator  constructed  a 
16-item  questionnaire  and  administered  it  to  students 
reporting  a visit  to  the  student  health  service  during 
the  semester  in  which  he  conducted  the  study. 

The  purpose  of  this  study  was  to  (a)  measure  patients' 
general  levels  of  satisfaction  with  health  care  delivered 
at  the  student  health  service,  (b)  identify  specific  elements 
of  service  in  which  a low  level  of  satisfaction  was  found, 

(c)  compare  patients'  satisfaction  ratings  of  three  staff 
physicians,  and  (d)  define  each  physician's  profile  of 
patient  satisfaction. 

In  general,  more  patients  were  satisfied  than  dissatisfied 
with  the  student  health  facility  but  their  satisfaction  seemed 
to  be  heavily  influenced  by  the  physician  who  conducted  the 
examination.  Results  of  the  study  by  McDaniel  (1979) 
revealed  a large  disparity  among  satisfaction  ratings  for 
the  three  physicians.  Respondents  whose  ratings  of  a 
physician  were  low  also  rated  other  aspects  of  satisfaction 
low.  This  study  supported  the  retaining  and  revision  of 
items  F and  G in  the  respondent-reported  data  section  of 
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hospital  services  and  staff  work  attitu 
the  combined  items  on  the  physical  environment  of  the  health 
care  facility  (parking,  atmosphere,  waiting  room  space,  and 
noise  level)  lower  than  all  other  aspects  of  care  included 
in  the  study  questionnaire.  Even  though  these  studies 
seem  to  support  the  existence  of  a relationship  between 
patient  satisfaction  and  the  physical  environment  of  the 
health  care  facility,  investigators  have  yet  to  determine 
the  strength  of  that  relationship.  Item  10  in  the  patient 
satisfaction  data  section  of  the  questionnaire  was  included 
in  the  instrument  developed  for  the  subject  student  health 
service  based  on  the  findings  of  the  research  cited  in  this 
paragraph  as  well  as  on  the  results  of  previous  patient 
satisfaction  surveys  conducted  in  the  subject  student  health 

literature  review,  the  study  of  patient  satisfaction  I 
conducted  in  the  subject  student  health  facility  was  similar 
to  other  studies  in  college  settings  (Gillette  et  al.,  1982; 
Liao  et  al.,  1978;  McDaniel,  1979)  in  that  the  purpose  was 
to  identify  problems  with  health  care  delivery  and  services 
in  one  university  health  care  facility.  In  the  studies  by 
Liao  et  al.  (1978)  and  McDaniel  (1979)  these  investigators 
gathered  data  relating  to  previously  identified  problems. 

The  subject  study  was  similar  to  that  of  Gillette  et  al. 
(1982)  in  that  both  explored  variables  thought  to  affect 
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patient  satisfaction  in  hopes  of  identifying  previously 
unrecognized  problems  with  health  care  delivery  and  services. 
The  subject  study  differed  from  others  conducted  in  college 
settings  (Gillette  et  al.,  1982;  Liao  et  al.,  1978;  McDaniel, 
1979)  as  follows:  (a)  the  use  of  a multidimensional  scale 

of  patient  satisfaction  producing  a Patient  Satisfaction 
Index  that  could  be  used  to  identify  variables  associated 
with  high  to  low  levels  of  patient  satisfaction  and  (b)  the 
use  of  a follow-up  administration  of  the  instrument  (to 
measure  its  reliability  over  time)  at  a time  2 to  4 weeks 
later  as  recommended  by  Nunnally  (1964)  to  minimize  the 
effects  of  respondents'  memories  of  their  responses  to  the 
initial  administration  of  the  instrument. 

Summary  of  Literature  Review 

Researchers  have  assessed  patients'  attitudes  about 
health  care  they  receive  in  a variety  of  settings  using 
different  approaches  and  conceptualizations.  Early 
investigators  of  patient  satisfaction  focused  on  determining 
behaviors  relevant  to  satisfaction,  improving  satisfaction 
data-collection  and  analysis  procedures,  and  using 
satisfaction  data  to  pinpoint  factors  that  negatively 
affect  patients'  perceptions  of  and  attitudes  about  health 
care  they  receive  in  a particular  facility. 

In  spite  of  lingering  confusion  about  what  data  to 
collect  and  how  to  use  the  information,  and  the  inability 
to  compare  studies  conducted  in  different  locations  for 
differing  purposes,  patient  satisfaction  research  has  evolved. 


CHAPTER  III 

METHODOLOGY  AND  INSTRUMENTATION 

The  primary  purpose  of  this  study  was  (a)  to  develop 
an  instrument  based  on  a review  of  the  instruments  used 
during  the  previous  4 years  in  the  subject  student  health 
service,  with  which  to  assess  user  satisfaction  with  health 
care  provided  by  a university  health  service,  (b)  to  assess 
the  validity  and  reliability  of  the  instrument,  (c)  to  test 
the  Instrument  through  the  collection  of  data  at  time  of 
service  delivery  and  at  a later  time,  and  (d)  to  compare 
the  level  of  user  satisfaction  at  time  of  service  delivery 
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well  as  in  other  college  health  settings  where  students 
have  health  care  experiences  similar  to  those  of  users  of 
the  subject  facility. 

The  research  questions  I investigated  were  (a)  whethf 
mean  Patient  Satisfaction  Index  values  would  differ 
significantly  in  a survey  of  users  conducted  immediately 
after  the  health  care  encounter  and  at  the  administration 


s by  ir 


with 


and  (b)  whether  average  user  satisfaction 
are  provided  at  one  student  health  service, 
sasured  by  a Patient  Satisfaction  Index,  would  differ 
•gnificantly  for  groups  of  users  categorized  by  response 
I 10  self-reported  items  included  in  the  respondent-repc 

This  chapter  contains  the  following  sections: 
vision/development  of  the  Patient  Satisfaction  Question 
e-testing  of  the  instrument,  the  initial  administration 
the  instrument,  the  follow-up  administration  of  the 
strument,  research  methodology,  and  data  analyses 
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Patient  Satisfaction  Questionnaire 
My  task  was  to  revise  the  satisfaction  assessment 
questionnaire  administered  in  the  subject  student  health 
service  during  the  4 years  preceding  this  study  so  that 
the  instrument  would  better  reflect  patients'  attitudes 
about  health  care  at  the  subject  facility  while  still 
collecting  specific  information  needed  by  administrators 
of  the  subject  student  health  service.  The  goal  of 
assessing  patient  satisfaction  for  the  student  health 
service  was  to  discover  problems  that  reduce  the  levels 
of  satisfaction  for  users.  These  problems  may  influence 
the  users'  decisions  (a)  to  comply  with  treatment  regimes 
and  (b)  to  return  to  the  subject  facility  for  future 
health  concerns  and  needs.  Information  collected  and 
analyzed  was  used  to  plan  for  the  improvement  of  future 

Setting  for  the  Study 

This  study  took  place  in  a student  health  service  in 
a large  (35,000  students)  southeastern  state  university. 

appropriations.  Funding  for  the  operation  is  derived  from 

portion  of  the  student  activity  fee  that  is  built  into 
tuition  fees;  (c)  the  health  fee  that  is  part  of  the 
registration  fee,  mandatory  for  full-time  students  and 


iptional  for  p; 


id  (d)  individi 


fees  for  services  rendered. 

The  subject  student  health  service  offers 
comprehensive  health  care  at  reduced  costs  along  with 
confirmation  of  health  problems  and  specialty  referrals. 
Services  include  a 24-hour  inpatient  unit;  laboratory, 
radiographic  and  pharmacy  services;  mental  health  and 
women's  clinics;  sexual  assault  recovery  services;  health 
education;  and  a variety  of  specialty  clinics  such  as 
allergy,  kidney,  blood  pressure,  wart,  orthopedics,  and 


Research  in  the  Natural  Setting 

According  to  Bailey  (1982) , applied  research  generates 
findings  useful  for  solving  problems  of  immediate  concern. 
Applied  research  often  entails  large-scale  studies  with 
subsequent  data  collection  problems.  Such  studies  are 
expensive  and  often  cannot  be  conducted  without  support 
from  a funding  agency  or  from  an  institution  that  has  an 
immediate  need  for  the  researcher's  findings  and 
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allows  the  researcher  the  advanta 
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Even  though  research  in  the  natural  setting  may  be 
more  difficult  to  control,  the  advantages  of  this  type  of 
investigation  outweigh  the  disadvantages. 


The  1983  Patient  Satisfaction  Questionnaire 

The  assessment  of  patients'  attitudes  about  health  c 


part  of  an  ongoing  quality  assurance  program  designed  to 
monitor  quality  of  health  care.  During  the  4 years 
preceding  the  data  collection  for  this  study,  patient 
satisfaction  researchers  at  the  student  health  service 

perceptions  of  the  quality  of  care  provided.  Even  though 
the  staff  made  minor  modifications  with  subsequent 


intact  during  the  4-year  period.  When  I began  this 
research  project,  the  patient  satisfaction  instrument 
consisted  of  the  following  four  sections  (see  Appendix  B 

1.  Cover  letter.  The  front  page  of  the  questionnai 
was  a letter  signed  by  the  director.  Student  Health  Servi 
stating  the  purpose  of  the  survey  and  assuring 
confidentiality  of  responses.  Instructions  encouraged 
users  to  complete  and  return  the  questionnaire  to  collecti 
boxes  in  the  waiting  areas  of  the  student  health  service. 


The  writer  thanked  respondents  for  their  help  with  the  sui 
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2.  General  respondent  data.  Respondent-reported, 
objective  data  collected  in  this  section  described  and 
categorized  users  of  student  health  service  by  (a) 
university  classification,  (b)  knowledge  and  use  of  student 
health  service,  (c)  time  required  for  the  health  service 
encounter,  and  (d)  health  insurance  coverage  of  the  user. 

3-  Patient  satisfaction  data.  Respondents  rated  the 
care  they  received  from  health  care  professionals  using 
the  following  scale:  not  used,  excellent,  good,  fair,  poor, 

or  no  opinion.  Using  this  scale,  respondents  rated  the 
care  they  received  from  physicians,  physicians'  assistants, 
nurse  practitioners,  registered  nurses,  laboratory  staff, 
pharmacy  staff,  radiographic  staff,  nursing  assistants/aides, 
front  desk  personnel  (check-in) , and  appointment  desk 
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horizontally  on  the  top  surface  of  the  folded  questionnaire. 
The  questionnaire  was  folded  so  that  the  general  respondent 
and  patient  satisfaction  data  sections  of  the  questionnaire 
appeared  on  the  inside  two  surfaces.  Questionnaires  were 
folded  when  given  to  the  respondents,  to  further  suggest 
the  confidentiality  of  the  participants'  responses.  The 
back  surface  of  the  folded  questionnaire  contained  the 


Stacks  of  questionnaires  were  placed  in  all  clinics 
and  waiting  areas  of  student  health  service.  The  staff 
members  were  encouraged  to  remind  users  of  the  importance 


requested  that  respondents  place  the  completed  surveys  in 
the  collection  boxes  located  throughout  the  facility  or 
return  them  to  the  front  desk  personnel. 

Staff  analyzed  data  on  questionnaires  by  (a)  calculating 
the  percentage  of  participants  who  responded  to  each 
response  choice  for  each  of  the  12  questions  included  in 


the  general  respondent  and  patient  satisfaction  data 
sections  of  the  questionnaire,  and  (b)  listing  all  of  the 


sampling  users  of  the  subject  student  health  service. 
Sampling  is  summarized  in  Table  1.  Only  users  of  the 
subject  facility  have  been  surveyed  in  these  past  studi 
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Past  investigators  selected  dates  for  data  collection 
that  would  minimize  disruption  within  the  subject  facility. 

Table  1 
Summary  of 

Patient  Satisfaction  Survey  Sampling 
in  Student  Health  Service 


Days  of  Patients. 
Collection  Data  Seen  at 

Cycle  Collection  SHS 


Percent  of  Users 
Surveyed  During 
Surveys  Data  Collection 
Completed  Period 


1982 

Apr.  5,  8,  11 


1035 

1498 

1564 

1561 


18.5 

30.9 


The  1984  Patient  Satisfaction  Questionnaire 

The  revised  Student  Health  Service  Patient  Satisfaction 
Questionnaire  also  consisted  of  four  sections.  The  rationale 
for  revising  each  section  is  included  in  the  discussion  that 
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reduce  disruption  in  the  subject  facility,  (b)  eliminate  the 
need  for  survey  collection  boxes,  and  (c)  increase  the 
percentage  of  completed  instruments  returned  during  the 
3-day  da ta-col lection  period.  I also  believed  that  student 
users  would  perceive  patient  satisfaction  data  collection 

were  present  to  collect  completed  surveys.  Nelson-Wernlck  et  al. 
(1981),  cited  in  Chapter  II,  supported  using  such  personnel. 

2'  General  respondent  data.  I modified  the  respondent- 
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index  allows  a researcher  to  place  individuals  along  a 
continuum  in  terms  of  their  sentiments  about  health  and 
medical  care  services. 

X based  the  design  of  the  Patient  Satisfaction  Index 
on  research  by  Hulka  et  al.  (1975)  and  Ware  et  al.  (1976). 
Hulka  et  al.  (1975)  assessed  satisfaction  with  health  care 
using  the  following  three  dimensions  (domains)  of  satisfaction: 
(a)  professional  competence  of  health  care  providers,  (b) 
personal  qualities  of  health  care  providers,  and  (c)  cost/ 
convenience  of  the  care  encounter.  Ware  et  al.  (1976) 
identified  five  major  dimensions  of  patient  satisfaction: 

(a)  quality  of  care,  (b)  accessibility /convenience,  (c) 
finances,  (d)  physical  environment,  and  (e)  availability. 
Subdimensions  of  the  auality-of-care  dimension  include  the 
art  of  care,  technical  aspects  of  care,  and  outcomes  of 

X constructed  Patient  Satisfaction  Index  items  with  a 
Likert  scale  format.  To  score  respondents'  ratings,  I 
coded  items  in  the  same  direction  with  a high  score 
indicating  satisfaction  and  a low  score,  dissatisfaction. 

I totaled  item  scores  to  calculate  the  scale  total  or 
Patient  Satisfaction  Index.  This  multidimensional  index 
allowed  patients  to  be  placed  along  a continuum  of 
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Respondent-reported  subjective  data  provided  a means 
of  assessing  and  summarizing  patient  satisfaction  with 
health  care  received.  Respondents  reported  their 
satisfaction  with  health  care  by  rating  10  neutral  statements. 

Xtems/statements  1-3  related  to  patients'  perceptions 
of  their  personal  relationship  (PR  domain)  with  health  care 

perceptions  of  professional  competence  (PC  domain)  of  health 
care  providers.  Items/statements  7-9  described  patients' 
appraisals  concerning  cost  and  convenience  (CC  domain)  of 
student  health  service  care  including  waiting  time  associated 
with  using  the  service.  Item/statement  10  was  a general 
rating  of  patients'  satisfaction  with  the  physical 
environment  within  the  facility.  Based  on  the  results  of 
previous  satisfaction  surveys  in  the  subject  student  health 
service,  I included  this  item  in  the  CC  domain  to  see 
whether  it  related  to  overall  satisfaction  with  care  provided 
as  determined  by  the  Patient  Satisfaction  Index. 

This  section  of  the  questionnaire  was  designed  in  a 
boxed  response/qrid  questionnaire  format.  Bailey  (1982) 
identified  several  advantages  of  using  this  questionnaire 
grid  format.  This  format  allowed  respondents  to  rate  the 
10  items  by  checking  the  appropriate  level  of  their 
satisfaction  using  the  following  scale:  very  satisfied 


I excluded  from  analyses  the  questionnaires  containing  the 
unable-to-answer  response  choice  for  any  of  the  10  items. 

A large  number  of  unable-to-answer  responses  on  any  item 
in  this  section  of  the  questionnaire  would  indicate  a problem 


I added  the  index  values  for  the  responses  to  the  10 
items  in  this  section  in  order  to  form  the  Patient 
Satisfaction  Index,  a numerical  value  describing  patient 
satisfaction  with  a health  care  encounter.  I grouped  health 
service  users  by  the  categorizing  items  contained  in  the 
general  respondent  data  section  of  the  questionnaire.  This 
grouping  of  student  users  provided  group  mean  indices.  A 
comparison  of  these  mean  group  indices  might  reflect 
differences  in  patient  satisfaction  for  specific  groups 
of  users. 

Even  though  I realized  that  respondents'  ratings  of 

produce  positively  skewed  results,  I decided  to  use  neutral 
statements  in  order  to  elicit  the  most  unbiased  responses 
possible  from  survey  participants.  According  to  Tuckman 
(1978,  pp.  198-199),  positive  and  negative  statements  may 
cause  a respondent  to  become  cautious  and  to  give  less-than- 
honest  answers.  In  attitude  measurement,  neutral  statements 

respondents  less  alarm. 


(producing 


Patient  Satisfaction  Index)  of  the 


questionnaire  was  represented  by  the  subject  study.  If 
this  data  collection  yielded  Patient  Satisfaction  Indices 
that  were  overly  skewed  in  a positive  direction  (reducing 
the  variability  of  respondents ' indices) , recommendations 
to  address  this  problem  in  future  data-collection  cycles 
based  on  recommendations  of  Bailey  (19S2)  will  be  included 

4.  Comments/suqqestions  for  improvement.  This 
open-ended  section  of  the  questionnaire  allowed  respondents 
to  (a)  clarify  and  qualify  responses,  (b)  comment  on  an 
issue  or  specific  problem  not  addressed  in  the  questionnaire, 

at  the  subject  health  service.  This  section  of  the  instrument 
also  served  as  a check  for  the  validity  of  the  Patient 
Satisfaction  Index. 

The  revised  questionnaire  was  reviewed  by  the  director 
and  members  of  the  quality  assurance  committee  of  the  subject 
health  service.  This  review  board  discussed  and  decided 
that  (a)  the  questionnaire  contained  no  sensitive  questions, 

(b)  the  data  collection  methods  assured  confidentiality  of 
responses,  and  (c)  involved  no  invasive  techniques. 

Therefore,  review  by  the  Committee  on  Human  Subjects  Research 
of  the  subject  institution  was  not  warranted. 

The  two-sided,  8>s  by  14  inch  questionnaire  was  printed 
on  both  sides  on  bright  yellow  paper  stock  according  to  the 
recommendations  of  Dunla 


»p  (1950)  . Qv. 
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£olded  lengthwise  so  that  the  cover 
horizontally  on  the  top  surface  of  the  folded  questionnaire. 
The  instrument  was  folded  so  that  the  general  respondent 
and  patient  satisfaction  data  sections  of  the  questionnaire 
appeared  on  the  inside  two  surfaces.  Questionnaires  were 
folded  and  placed  on  clipboards  when  given  to  respondents 
to  further  suggest  the  confidentiality  of  participants' 
responses.  The  back  page  of  the  questionnaire  contained 
the  open-ended,  comments  section  of  the  instrument. 

The  follow-up  questionnaire  was  identical  to  the  one 
described  above  with  the  exception  of  the  color  (blue)  of 
paper  on  which  it  was  printed.  The  color  of  the  two  forms 
was  different  to  facilitate  handling  of  completed  surveys. 
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During  this  pretesting  of  the  instrument,  I determined 

that  appeared  long  and  time  consuming  to  fill  out.  With 
the  respondent  in  mind,  I reorganized  the  patient  satisfaction 
data  section  of  the  guestionnaire  into  a boxed  response/ 
grid  format.  This  format  contributed  to  efficient  use  of 
space  and  ease  and  speed  of  completing  questionnaires.  When 
I used  a single  response  scale,  one  set  of  instructions 
applied  to  all  10  items  in  this  section.  Statements  such 
as  those  used  in  this  questionnaire  section  would  elicit 
unbiased  responses  from  those  completing  the  survey 

As  a result  of  this  pretesting  of  the  instrument,  X made 
the  following  changes  before  performing  a second  pretestings 

(b)  added  an  unable  to  answer  response  choice  to  several 
items,  and  (c)  adopted  the  boxed  response/grid  questionnaire 
format  for  the  patient  satisfaction  data  section,  giving  the 
questionnaire  the  appearance  of  being  shorter  and  easier 
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employees  of  the  subject  facility  from  the  Quality 
mce  and  Health  Education  divisions  and  student 
teer  members  of  the  Student  Health  Outreach  Team.  I 
participated  in  the  data  collection  to  monitor  proce 
'sure  that  disruption  of  health  care  provision  was 
akly,  inter-facility  memorandum 
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facility  was  reminded 
March  28,  1984. 

Users  of  the  student  health  service  received 
questionnaires  from  questionnaire  administration  person 
after  their  health  care  encounters  but  before  leaving  t 
facility.  Questionnaire  administration  personnel,  with 
supply  of  questionnaires  and  equipped  with  clipboards  a 
pencils  for  the  convenience  of  respondents,  stationed 
themselves  at  exits  to  the  student  health  service. 
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questionnaire  administration  personnel  station  themselves 
at  the  front  and  pharmacy  (side)  exits. 

In  training  questionnaire  administration  personnel, 

I (a)  gave  a 15-minute  oral  briefing  on  procedures  to  be 
followed  to  reduce  the  chances  of  their  biasing  responses 
and  (b)  gave  them  written  instructions  describing  the 
procedures  they  were  to  follow.  I encouraged  them  to  seek 
as  many  completed  questionnaires  as  possible  while  avoiding 
influencing  the  responses  of  users. 

administration  personnel  (a)  to  collect  as  many  completed 
questionnaires  as  possible  without  disrupting  student  health 
service  activities,  and  (b)  to  ask  if  each  user  would  be 
willing  to  complete  the  second,  follow-up,  mailed 
questionnaire  (see  Appendix  C) . 

S?oSfi0n  °f  the  Initial  Administration  of  the  1984 
The  population  (sampling  frame)  for  this  study  included 
all  of  those  users  who  visited  student  health  service  during 
the  year  of  this  data  collection  cycle.  Since  surveying 
the  total  population  was  not  feasible,  I chose  a smaller 
target  population— users  who  visited  the  student  health 
service  during  a 3-day  period.  The  time  period  for  data 


typical 


student  health  service  usage  during  non-peak  periods, 
selected  in  part  to  minimize  disruption  within  the  facility 
during  questionnaire  administration. 

Investigators  studying  patient  satisfaction  in  the 
natural  setting  must  be  careful  not  to  jeopardize  health 
care  delivery  services  during  data  collection.  For  this 
reason,  I chose  a time  period  during  the  academic  semester 
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year. 
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because  student  health  service  usage  is  usually  at  its 
highest  at  these  times.  In  an  already  over-crowded  facility, 
any  additional  activity  during  peak-use  periods  may  interfere 
with  the  delivery  of  health  care  services. 

Mondays  and  Fridays  are  generally  the  busiest  days  at 
this  facility  in  terras  of  patients  seen  by  health  care 
providers.  Tuesdays,  Wednesdays  and  Thursdays  are  slightly 
less  busy.  I selected  Wednesday,  Thursday,  and  Friday  as 
days  representative  of  typical  non-peak  usage  in  the  subject 
student  health  service  facility. 

users  as  possible  who  visited  the  student  health  service 
during  the  3-day  data  collection  period.  The  goal  for 
surveying  patients  was  to  exceed  the  percer 
patients  who  completed  satisfaction  surveys 
health  service  in  the  preceding  data  collec 
(see  Table  1) . 
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My  decision  to  retain  the  nonprobability  sampling 
procedures  established  in  previous  satisfaction  studies  in 
the  subject  facility  was  supported  by  Bailey  (1982)  in  that 
my  interest  was  in  perfecting  the  questionnaire  during  this 
data-collection  cycle.  I address  improvement  of  sampling 
techniques  in  future  replications  of  this  study  in  the 
recommendations  section  of  Chapter  V. 

Selection  of  Follow-up  Participants 

The  follow-up  administration  of  the  1984  Patient 
Satisfaction  Questionnaire  was  accomplished  within  the  2- 
to  4-week  time  period  recommended  by  Nunally  (1978) . 

When  users  returned  completed  surveys  to  questionnaire 
administration  personnel,  they  were  asked  to  participate 
in  the  follow-up  administration  of  the  Patient  Satisfaction 
Questionnaire.  Users  were  not  aware  that  the  follow-up 
instrument  would  be  identical  to  the  initial  one  in  form 
and  content.  While  an  individual  who  agreed  to  participate 
in  the  follow-up  evaluation  addressed  an  envelope  to 
himself  or  herself  for  mailing  the  form,  the  survey  staff 
member  administering  the  questionnaire  (a)  coded  the 
follow-up  form  with  the  same  number  as  that  coded  on  the 
original  form  and  (b)  recorded  the  respondent's  first 
name,  phone  number,  and  questionnaire  code  number  on  a 
telephone  follow-up  code  sheet  (see  Appendix  D) . In  this 
way,  we  could  match  the  two  forms  completed  by  each 
participant  and  if  needed,  make  a follow-up  telephone  call 


to  nonrespondents  while  maintaining  no  record  of  the 
respondent's  name  and  address.  Respondents  were  informed 
verbally  by  questionnaire  administration  personnel  that 
the  telephone  follow-up  code  sheet  would  be  destroyed 
at  the  end  of  the  semester.  This  procedure  maintained  the 
confidentiality  of  responses. 

According  to  the  questionnaire  administration 
personnel,  the  most  common  reasons  users  declined  to 
participate  in  the  follow-up  study  was  a shortage  of  time. 

I instructed  questionnaire  administration  personnel  to  ask 
as  many  of  those  completing  the  principal  survey  as 
possible  to  participate  in  the  follow-up  survey.  Problems 
inherent  in  collecting  data  in  the  natural  setting  precluded 
survey  personnel  from  asking  all  initial  respondents  to 
participate  in  the  follow-up  study.  Questionnaire 
administration  staff  decided  which  of  those  completing 
the  original  survey  they  would  ask  to  complete  the  second 


salth 


follow-up  questionnaires.  I mailed  the  follow-up 
questionnaires  bulk-rate  18  days  after  the  initial 
questionnaire  administration  period. 

To  comply  with  the  request  of  the  financial 
administrator  of  the  subject  student  health  service,  I 
used  a bulk-rate  mail  permit  to  administer  the  follow-up 
surveys.  This  was  not  my  method  of  choice  based  on  the 
literature  review  of  others  conducting  mailed  surveys  of 
patient  satisfaction.  The  postage-paid  envelopes  for 
participants  to  use  in  returning  the  completed  questionnaires 

The  postal  service  does  not  return  undeliverable 
mail  sent  under  a non-profit  bulk-rate  mailing  permit. 

For  this  reason,  I would  be  unsure  whether  the  participants 
actually  received  the  follow-up  questionnaire  or  merely 
failed  to  complete  and  return  it.  Another  anticipated 
problem  in  using  the  bulk-rate  mailing  permit  was  the 
additional  time  required  by  slow-moving  mail.  Participants 
could  receive  the  follow-up  surveys  too  close  to  the 

end  of  the  term  and  the  beginning  of  final  examinations 

a factor  that  could  interfere  with  the  follow-up  return 


The  use  of  the  bulk-rate  mail  permit  interfered 
a than  1 could  have  anticipated  with  the  follow-up 
arn  rate.  Due  to  an  error  of  the  campus  postal  ser 
printing  department  of  the  subject  university  was 
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given  an  incorrect  bulk-rate  permit  number,  resu 
in  the  printing  of  the  envelopes  with  an  incorrect 
bulk-rate  permit  number  for  return  of  the  follow-up 
surveys.  The  campus  postal  system  uses  only  the  bulk-rate 
permit  number  for  sorting  mail  arriving  at  the  subject 
institution.  Consequently,  the  majority  of  returned 
surveys  were  delivered  to  the  Continuing  Education 
Division  of  the  subject  university,  which  is  located 
off  the  campus  proper.  Even  though  representatives  of 
the  Continuing  Education  division  were  most  cooperative 
about  receiving  and  delivering  the  misrouted  returned 
questionnaires,  I had  no  way  of  determining  whether  some 
surveys  had  been  lost  in  the  confusion.  This  situation 
will  be  addressed  in  the  recommendations  sections  of 


Campbell  and  Stanley  (1963)  described  a research 
design  for  field  investigators  in  which  the  researcher 
begins  with  an  inadequate  design  and  then  adds  specific 
features  to  control  for  one  or  another  of  the  recurrent 
sources  of  invalidity.  The  Recurrent  Institutional  Cycle 

given  aspect  of  an  institutional  process  is,  on  some 
cyclical  schedule,  continually  being  presented  to  a new 
group  of  respondents.  Such  situations  include  higher 
education  institutions  and  their  he 
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According  to  Campbell  and  Stanley  (1963),  if  in 
these  situations  one  is  interested  in  evaluating  the 
effects  of  a global  and  complex  construct  (such  as 
patient  satisfaction) , then  the  Recurrent  Institutional 
Cycle  design  probably  offers  as  near  an  answer  as  is 

developed  thus  far. 

In  the  subject  student  health  service,  previous 
patient  satisfaction  researchers  used  the  One-Shot  Case 
Study  pre-experimental  design.  This  weak  research 
design  has  inherent  sources  of  internal  invalidity.  The 
primary  focus  of  this  research  was  to  assess  the  reliability 
and  validity  of  the  measurement  instrument  (the  Patient 
Satisfaction  Questionnaire  developed  for  use  in  this 
research  project) . A second  effort  to  strengthen  the 
design  of  the  study  and  reduce  threats  to  internal 
validity  was  the  addition  of  a second  pre-experimental 
design  to  the  one  previously  used.  The  One-Group 
Pretest  and  Posttest  design  added  controls  for  maturation 
and  selection.  According  to  Campbell  and  Stanley  (1963), 
the  combination  of  two  such  inadequate  designs  may  have 
considerable  strength. 

The  Recurrent  Institutional  Cycle  design  (Campbell 
* Stanley,  1963)  as  used  in  this  study  can  be  diagrammed 
as  follows: 


Experimental  group 


X1  °1  X2  °2 

where : 

X^  represents  a student  health  service  health  care 
encounter ; 

0^  represents  the  administration  of  the  1984  survey 
immediately  after  health  care  provision; 

Xj  represents  the  passage  of  time  allowing  for 
maturation  to  determine  if  realization  of  the  outcomes  of 
the  health  care  encounter  have  an  effect  on  patients' 
ratings  of  their  satisfaction  with  the  health  care  they 
receive  at  student  health  service;  and 

°2  represents  a second  administration  of  the 
questionnaire  to  a subgroup  of  those  completing  the 
principal  administration  of  the  questionnaire  at  a 
later  date  and  in  a location  away  from  the  institutional 
setting  of  the  student  health  service  health  care 
facility. 

The  questionnaire  administrations  represented  by 
0^  and  Oj  was  accomplished  with  the  same  instrument  with 
the  exception  of  the  color  of  paper  on  which  it  was  printed. 
The  study  group  for  the  second  administration  of  the 
questionnaire  was  a subgroup  of  those  users  completing 
the  principal  administration  of  the  survey. 
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Data  Analyses 

£ used  the  following  procedures  to  test  the  four 
null  hypotheses  relating  to  the  primary  purpose  of  this 

Validity  of  the  1984  Patient  Satisfaction  Questionnaire 

Carmines  and  Zeller  (1979,  p.  17)  defined  validity 
as  the  extent  to  which  any  assessment  instrument  measures 
what  it  is  intended  to  measure.  These  authors  went  on  to 
write  that  to  generate  usable  data,  one  must  validate  a 
measuring  instrument  in  relation  to  the  purpose  for  which 
it  was  designed  (Carmines  & Zeller,  1979,  p.  17). 

To  pass  the  test  of  content  validity,  a comprehensive 
patient  satisfaction  survey  must  include  items  representing 
all  pertinent  satisfaction  dimensions  and  subdimensions. 
Ware  (1981)  recommended  three  procedures  for  assessing 
the  validity  of  a satisfaction  questionnaire  constructed 
to  meet  the  individual  information  needs  of  specific 
health  care  facility  administrators.  These  recommended 
procedures  are  described  below. 

1.  Design  a patient  satisfaction  index  based  on  a 
taxonomy  of  satisfaction  as  tested  and  validated  by 
previous  researchers. 

2.  Include  an  open-ended  item  on  the  questionnaire — 
an  item  that  asks  respondents  for  further  comments  about 
their  health  care  encounter  (refer  to  hypothesis  A) . 
Multiple  respondent  comments  on  some  aspect  of  the  health 
care  encounter  highlight  problem  areas  within  a survey 


instrument.  Responses  to  the  open-ended  items  alert 
researchers  to  important  satisfaction  dimensions  that 
were  either  omitted  or  not  clearly  or  adequately  addressed 
by  patient  satisfaction  data  items.  If  the  items  forming 
the  Patient  Satisfaction  Index  or  scale  adequately  describe 
satisfaction,  comments  will  focus  on  (a)  specific  instances 
of  care  for  specific  individuals  or  (b)  respondent 
amplification  of  responses  to  items  comprising  the 
satisfaction  scale. 

3.  Conduct  an  item-analysis  to  study  the 
interrelationships  among  (a)  the  10  items  in  the  Patient 
Satisfaction  Index  or  scale  and  the  index  itself  (refer  to 
hypothesis  B) , and  (b)  conduct  a factor  analysis  to  study 
the  interrelationships  among  each  domain  and  the  Patient 
Satisfaction  Index  (refer  to  hypothesis  C) . 

In  using  these  methods  the  investigator  makes  the 
assumption  that  each  item  within  a domain  contains  a 
substantial  amount  of  information  about  respondents' 
satisfaction  with  health  care  encounters  as  well  as 
information  about  the  particular  domain  itself.  The 
researcher  can  test  this  assumption  by  correlating  each 
item  with  the  Patient  Satisfaction  Index.  Using  this 
test  of  item  homogeneity  (hypothesis  B) , items  that 
belong  in  the  scale  will  correlate  substantially  (p  < . 0001) 
(r  = .40)  with  each  other  and  with  the  Patient  Satisfaction 
Index.  This  test  can  also  be  used  to  assess  the  homogeneity 
of  the  domains  included  in  the  Patient  Satisfaction  Index 


(hypothesis  C) . To  be  included  in  the  Patient  Satisfaction 
Index  scale,  each  domain  should  also  correlate  substantially 
(p  4 .0001)  with  the  Patient  Satisfaction  Index. 

In  addition  to  testing  for  item  and  domain  homogeneity, 
the  investigator  should  evaluate  the  correlation  between 
each  item  within  a domain  and  the  other  items  on  the  scale 
(refer  to  hypothesis  B) . This  test  of  discriminant  validity 
assesses  whether  the  item  measures  the  hypothesized  domain 
of  satisfaction  more  than  the  other  domains  in  the  scale. 
Intercorrelations  of  items  within  a domain  should  be  greater 
than  the  intercorrelations  of  items  between  domains.  If  this 
situation  does  not  occur,  an  item  representing  significant 
information  about  patient  satisfaction  may  be  placed  in  an 
inappropriate  domain. 

I used  these  three  procedures  suggested  by  Ware  (1981) 
for  assessing  content  validity  of  the  Patient  Satisfaction 
Questionnaire  I developed  for  use  in  this  study. 

Reliability  of  the  1984  Patient  Satisfaction  Questionnaire 

Reliability  of  a measuring  instrument  concerns  the 
degree  to  which  results  are  consistent  across  repeated 
measurements  (Carmines  & Zeller,  1979,  pp.  11-12). 

I used  the  follow-up  administration  of  the  questionnaire 
to  test  null  hypothesis  D.  I hypothesized  that  no  significant 
difference  (using  a 95%  level  of  confidence)  would  occur 
in  the  mean  index  value  of  users  surveyed  immediately  after 
the  health  care  encounter  and  the  mean  index  value  of  those 
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same  users  participating  in  the  follow-up  study  surveyed 
by  mail  2 to  4 weeks  later.  This  procedure  allowed 
respondents  to  realize  the  outcomes  of  their  health  care 
encounters  before  responding  to  the  same  items  a second 
time.  To  answer  this  research  question,  I used  a test-retest 
measure  of  validity  as  recommended  by  Carmines  and  Zeller 
(1979,  pp.  37-40). 

Burke  (1974)  described  the  college  population  as  one 
operating  on  a low  level  of  need  for  health  care  services. 

For  this  reason,  I assumed  that  the  average  satisfaction 
index  of  a population  seeking  health  care  and  services  for 
health  problems  that  are  frequently  self-limiting  or  not 
perceived  as  being  life-threatening,  would  be  relatively 
stable  over  time,  thus  demonstrating  the  reliability  of 
the  instrument. 

Research  Questions 

To  answer  the  first  research  question  (Will  the  mean 
Patient  Satisfaction  Index  values  differ  significantly 
when  users  are  surveyed  immediately  after  the  health  care 
encounter  and  when  the  same  users  are  questioned  by  mail 
2 to  4 weeks  later?) , I used  a one-way  analysis  of 
regression  procedure  to  determine  if  a significant 
difference  existed  in  the  mean  Patient  Satisfaction  Index 
of  a subgroup  of  the  population  who  completed  the  principal 
administration  of  the  questionnaire  and  that  same  subgroup 
of  the  population  who  returned  the  follow-up  questionnaire. 


10  null  hypotheses  contained  within 


second  research  question  {Would  mean  scores  for  user 
satisfaction  with  the  subject  student  health  service,  as 
measured  by  the  Patient  Satisfaction  Index,  differ 
significantly,  using  a 95%  confidence  level,  when 
respondents  were  categorized  by  the  10  grouping  variables 
[multiple  response-choice  items]  contained  in  the 
respondent-reported  data  section  of  the  questionnaire?) , I 
used  a 10-factor  analysis  of  variance  regression  procedure. 

I used  a 10-factor  analysis  procedure  rather  than  10 
separate  one-way  analyses  for  three  reasons  (Huck,  Cormier, 

& Bounds,  1974,  p.  7B) : (a)  the  single,  10-way  analysis 

of  variance  regression  procedure  is  more  parsimonious 
(that  is,  it  answered  the  same  questions  more  quickly 
and  with  less  computation) ; (b)  the  single  analysis 
procedure  is  more  sensitive  to  differences  among  the  groups 
being  compared;  and  (c)  with  the  single  analysis  procedure 
one  can  investigate  the  effects  of  several  interactions 
of  interest  between  independent  variables.  Interaction  is 
the  effect  on  the  dependent  variable  (the  Patient  Satisfaction 
Index  in  this  study)  of  two  or  more  independent  variables 
(the  grouping  variables  in  this  study)  operating  together. 

a disadvantage  of  using  a single,  10-way  analysis  of  variance 
regression  procedure  was  the  number  of  possible  interactions 
that  result.  Funding  limitations  for  analyses  and  the 
recommendation  of  Huck  et  al.  (1974,  pp.  78-99)  on 
multifactor  analyses  predicated  my  decision  to  examine  only 


three  first-order  interactions  of  interest  to  this  study. 
Since  the  literature  contains  evidence  that  (a)  satisfaction 
with  health  care  is  a multidimensional  concept  and  (b)  each 
of  the  items  in  the  respondent-reported  data  section  of  the 
questionnaire  has  been  shown  to  be  related  to  satisfaction, 
the  intent  of  this  analysis  procedure  was  to  examine  the 
main  effects  of  the  10  general  respondent  data  items  included 
in  the  questionnaire. 

Using  this  procedure,  each  question  contained  in  the 
general  respondent  data  section  of  the  questionnaire  became 
a grouping  variable.  I formed  comparison  groups  for  each 
item  based  on  the  users'  response  choices  for  that  particular 
item.  Because  of  the  large  number  (406  individuals)  of 
users  surveyed,  I assumed  subgroups  of  respondents  would 
exhibit  normal  distributions  if  response  categories  of 
items  were  adequate  to  discern  differences  in  respondents' 
reactions  to  items  contained  in  this  questionnaire  section. 
Bailey  (1982,  pp.  100-101)  supported  this  assumption. 

The  analysis  procedure  used  determined  if  significant 
differences  existed  between  any  of  the  groups  formed  for 
each  of  the  item  comparisons.  I used  the  Scheffe"  procedure 
to  determine  where  significant  differences  were  within  the 
groups  formed  for  each  respondent-reported  data  section  item. 

This  data  analysis  methodology  was  planned  and  executed 
with  the  assistance  of  a biostatistician  from  the  Northeast 
Regional  Data  Center  of  the  subject  university.  Data  analysis 
and  findings  are  presented  in  the  following  chapter. 


CHAPTER  IV 

PRESENTATION  OF  RESULTS 


The  primary  purpose  or  this  study  was  (a)  to  develop 
an  instrument  based  on  a review  of  the  instrument 
administrations  during  the  previous  4 years  in  the  subject 
student  health  service,  with  which  to  assess  user  satisfaction 
with  health  care  provided  by  a university  health  service,  (b) 
to  assess  the  validity  and  reliability  of  the  instrument,  (c) 
to  test  the  instrument  through  the  collection  of  data  at  time 
of  service  delivery  and  at  a later  time,  and  Id)  to  compare 
the  level  of  user  satisfaction  at  time  of  service  delivery 
and  at  a later  time. 

The  secondary  purpose  of  this  study  was  (a)  to  group 
and  compare  survey  participants  by  their  self-reported 
responses  to  questions  contained  in  the  respondent-reported 


data  section  of  the  questionnaire,  (b)  to  compare  these 
groups  and  their  mean  levels  of  satisfaction  with  the 
subject  health  service  as  measured  by  the  Patient  Satisfaction 
Index,  and  (c)  to  provide  administrators  of  the  facility  with 
data  organised  to  reflect  differences  in  the  satisfaction 
of  groups  of  users  categorized  by  their  self-reported 
characteristics  in  order  to  identify  problem  areas  in 
providing  student  health  care  in  that  institution. 
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I used  a one-way  analysis  of  variance  regression 
procedure  to  assess  the  reliability  of  the  1984  Patient 
Satisfaction  Questionnaire.  The  Patient  Satisfaction 
Index  served  as  the  dependent  variable  to  answer  the 
first  research  question:  Will  the  mean  Patient  Satisfaction 

Index  values  differ  significantly  (using  a 95%  level  of 
confidence)  when  users  are  surveyed  immediately  after  the 
health  care  encounter  and  when  the  same  users  are  questioned 
by  mail  2 to  4 weeks  later? 

I used  a multiple  regression  analysis  of  variance 
procedure  to  answer  the  10  subquestions  contained  within 
the  second  research  question:  Would  mean  scores  for  user 

satisfaction  with  the  subject  student  health  service,  as 
measured  by  the  Patient  Satisfaction  Index,  differ 
significantly  (using  a 95%  confidence  level)  when  respondents 
were  categorized  by  the  10  grouping  variables  (multiple 
response-choice  items)  contained  in  the  respondent-reported 
data  section  of  the  questionnaire?  The  Patient  Satisfaction 
Index  again  served  as  the  dependent  variable  while  the  10 
grouping  variables  served  as  independent  variables  for  this 
analysis. 

This  chapter  contains  the  following  sections:  validity 

and  reliability  assessments  of  the  1984  Patient  Satisfaction 
Questionnaire,  the  results  of  the  analysis  procedure  used 
to  answer  the  first  research  question,  and  the  results  of 
the  analysis  procedure  used  to  answer  the  10  subquestions 
contained  within  the  second  research  question. 


Patient  Satisfaction  Survey 


Before  reporting  the  findings  of  the  subject  study, 
an  examination  of  the  study  group  used  is  in  order. 

According  to  Bailey  (1982,  p.  97),  investigators  using 
nonprobability  sampling  procedures  cannot  claim  that  the 
sample  was  representative  of  the  larger  population  (the 
sampling  frame)  because  the  probability  that  an  individual 
was  included  in  the  sample  was  unknown.  Even  though  I was 
more  interested  in  perfecting  the  subject  questionnaire 
than  in  the  sample  used  in  this  study,  the  representativeness 
of  the  study  group  was  of  interest  to  administrators  of 
the  subject  facility.  These  administrators  would  use  the 
satisfaction  data  generated  to  identify  problematic  aspects 
of  using  the  subject  facility,  staff,  and  services  for 
meeting  health  care  needs  of  student  users. 

Since  sampling  techniques  will  be  an  issue  in 
subsequent  patient  satisfaction  data-collection  cycles  in 
the  subject  facility,  a closer  look  at  the  study  group  used 
in  this  study  provided  valuable  information  for  making 
recommendations  for  subsequent  studies  in  the  subject 
health  service.  I used  four  assessments  to  examine  the 
study  group.  They  are  described  below. 

1.  An  examination  of  the  distribution  of  Patient 
Satisfaction  Indices  for  the  initial  administration  of 
the  Patient  Satisfaction  Questionnaire  that  occured  in 
March,  1984.  This  assessment  was  conducted  to  determine 


90 

the  normality  of  the  distribution  of  indices  of  the  306 
of  406  questionnaire  respondents  who  completed  the  entire 
questionnaire.  Even  though  I expected  some  degree  of 
positive  skewing  for  the  distribution  (resulting  from  the 
use  of  neutral  statements  in  the  patient  satisfaction  data 
section  items) , I had  made  the  assumption  that  the  distribution 
would  be  somewhat  normal  in  order  to  use  analysis  of  variance 
regression  procedures  (see  Figure  1) . 

2.  A comparison  of  the  number  of  (a)  annual  average 
daily  visits  to  the  subject  facility  during  the  1983-84 
fiscal  year;  (b)  the  monthly  average  daily  visits  for 
March,  1984;  and  (c)  the  actual  number  of  visits  during 
the  March,  1984  data-collection  period  (see  Table  2) . 

3.  A comparison  of  the  average  (a)  1983-84  annual, 

(b)  March,  1984  monthly,  and  (c)  March  28-30,  1984  data 
collection  period  (self-reported  by  respondents  who 
participated  in  the  study)  percentages  of  patients  seen 
by  physicians  (MDs) , physician's  assistants  (PAs) , 
nurse  practitioners  (NPs) , and  registered  nurses  (RNs) . 

4.  A comparison  of  percentages  of  those  responding 
to  the  questionnaire  during  the  3-day  survey  period  to 
the  entire  population  of  the  subject  university  (as 
classified  by  the  Registrar  of  the  subject  university) 
when  the  study  group  was  divided  into  university 
classifications  by  respondents'  self-reported  answers  to 
the  question.  What  is  your  university  classification? 


The  first  assessment  of  the  study  group  is  demonstrated 
in  Figure  1.  Even  though  the  bar  graph  shows  a positive 
skewing  of  indices,  the  distribution  is  somewhat  normal 
with  the  exception  of  the  index  range  from  47-50.  This 
extreme  positive  skewing  of  the  distribution  of  indices 
for  those  respondents  who  were  very  satisfied  with  their 
experiences  at  the  subject  student  health  facility  is  not 
surprising  when  one  considers  (a)  the  discussion  in 
Chapter  1 of  cognitive  dissonance,  (b)  the  discussion  of 
Ware  s work  (1978)  in  Chapter  II  on  acquiescence  response 
set,  and  (c)  the  fact  that  this  study  assessed  the  levels 
of  satisfaction  and  dissatisfaction  for  users  of  the  subject 
student  health  service  only.  During  the  data-collection 
cycle  of  this  study,  no  attempt  was  made  to  determine  if 
barriers  to  access  and  usage  existed  for  some  of  the 
members  of  the  total  subject-university  population.  Users 
who  visited  the  subject  facility  in  the  past  and  had 
negative  experiences  there,  may  have  turned  to  other 
sources  of  health  care  and  services.  Usage  and  access 
considerations  for  nonusers  of  the  subject  student  health 
service  will  be  addressed  in  future  patient  satisfaction 
data-collection  cycles. 


The  second  comparison  assessment  of  the  study  group 
shown  in  Table  2.  This  table  supports  the  assumption 
at  the  3 days  chosen  for  data  collection  were  typical 
n-peak  usage  days  for  the  subject  student  health  service. 
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see  a health  care  professional.  On  the  basis  of  the  review 
of  literature  in  Chapter  XI,  one  might  expect  the  mean  level 
of  satisfaction  to  be  lower  for  the  follow-up  subgroup 
because  of  the  longer  waiting  times  to  see  a health  care 
provider  for  a larger  percentage  of  respondents  in  this 
subgroup. 

Validity  and  Reliability 
of  the  1984  Patient  Sat Lsfaotj  3ues~ • 

I used  three  procedures  suggested  by  Ware  (1981)  for 
assessing  content  validity  of  the  Patient  Satisfaction 
Questionnaire  developed  for  use  in  one  student  health 
facility. 

Procedure  1.  Ware  (1981)  recommended  that  design 
of  a patient  satisfaction  index  be  based  on  a taxonomy 
of  satisfaction  tested  and  validated  by  previous  research 
efforts.  Design  of  the  subject  Patient  Satisfaction  Index 
was  based  on  the  domains  of  satisfaction  as  defined  in  the 
research  of  Hulka  et  al.  (1975)  and  Ware  et  al.  (1976). 

Hulka  et  al.  (1975)  assessed  satisfaction  with  health 
care  using  the  following  three  dimensions  of  satisfaction: 

(a)  professional  competence  of  the  health  care  provider, 

(b)  personal  qualities  of  the  health  care  provider,  and  (c) 

cost/convenience  of  the  health  care  encounter.  Ware  et  al. 
(1976)  identified  five  major  dimensions  of  patient 
satisfaction:  (a)  quality  of  care,  (b)  accessibility/ 

convenience,  (c)  finances,  (d)  physical  environment  and 


(e)  availability.  Subdimensions  of  the  quality  of  care 
dimension  included  the  art  of  care,  technical  aspects  of 
care,  and  outcomes  of  care.  According  to  Ware  (1981),  the 
purpose  of  the  questionnaire  and  the  intended  use  of  data 
collected  determine  which  domains  of  satisfaction  to  include 
in  the  questionnaire.  In  this  study,  I examined  user 
satisfaction  with  the  subject  student  health  service  and 
not  usage.  I did  not  emphasize  the  accessibility  and 
availability  of  services  domains  in  the  questionnaire  items 
(see  Appendix  A for  the  complete  questionnaire)  nor  did  I 
attempt  to  survey  nonusers  of  the  subject  student  health 
facility. 

Procedure  2.  Ware  (1981)  recommended  the  inclusion 
of  an  open-ended  item  on  the  questionnaire  that  asked 
respondents  for  further  comments  about  their  health  care 
encounter.  Responses  to  the  open-ended  item  alert 
researchers  to  important  satisfaction  dimensions  that 
were  either  omitted  or  not  clearly  or  adequately  addressed 
in  the  patient  satisfaction  data  section  items.  This 
open-ended  item  also  provided  respondents  an  opportunity 
to  single  out  aspects  of  satisfaction  with  health  care 
about  which  they  felt  most  strongly. 

Following  the  recommendations  of  Ware  (1981) , I 
included  an  open-ended  item  on  the  questionnaire.  I 
sorted,  grouped,  and  analyzed  responses  to  this  open-ended 
item  to  assess  the  validity  of  the  domains  included  in 
the  revised  1984  questionnaire  (see  Appendix  F for  a 


complete  list  of  responses  to  this  item) . This  analysis 
was  performed  to  test  hypothesis  A : Users'  responses  to 

the  open-ended,  comments  item  on  the  questionnaire  will  not 
identify  important  aspects  of  satisfaction  that  were  either 
(a)  omitted  or  (b)  not  clearly  or  adequately  addressed  by 
the  patient  satisfaction  data  items  included  in  the  Patient 
Satisfaction  Index  (a  numerical  summary  of  patient  satisfaction) . 

Of  the  406  questionnaires  completed  during  the  initial 
data-collection  period  (March  28-30,  1984),  126  respondents 
included  comments/suggestions  for  improvement  on  the  open-ended 
item.  To  facilitate  analysis,  I grouped  responses  to  this 
item  as  follows:  (a)  issues  concerning  access,  such  as 

cost,  convenience,  making  appointments,  waiting  time,  and 
insurance  issues  (56  comments) ; (b)  issues  concerning  quality 
of  care/staff,  such  as  sensitivity,  medical  competence, 
staffing,  and  comments  on  specific  clinics  or  services 
(80  comments):  (c)  issues  concerning  the  student  health 
facility  and  environment  (17  comments);  and  (d)  suggestions 
for  improving  the  subject  student  health  service  (14  comments) . 
Some  individual  respondents  made  comments  in  several  of 
the  categories  identified  above. 

The  comments/suggestions  represented  individual 
opinion.  Some  comments  reflected  a lack  of  awareness  of 
health  care  services  in  general.  Others  reflected  a lack 
of  awareness  of  procedures  and  services  provided  at  the 
facility.  Comments  about  dissatisfaction  with  quality 


staff  related  to  specific 
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and  were  undoubtedly  colored  by  Influences  other  than  what 
was  reported  in  these  brief  patient  statements. 

With  the  exception  of  comments  on  factors  affecting 
use  of  the  student  health  service,  responses  to  this 
open-ended  item  supported  the  taxonomy  of  satisfaction  used 
in  the  patient  satisfaction  data  section  of  the  questionnaire. 
Comments  did  focus  on  specific  amplification  of  responses  to 
items  comprising  the  patient  satisfaction  data  section  of 
the  questionnaire. 

The  numerous  responses  (56)  relating  to  use  of  the 
student  health  service  confirmed  the  need  to  address  user 
satisfaction  as  well  as  usage  of  the  facility  in  the  next 
patient  satisfaction  data-collection  cycle.  But  even 
among  these  respondent  comments,  none  related  to  aspects  of 
satisfaction  that  were  not  included  in  either  the 
respondent-reported  data  or  patient  satisfaction  data 
sections  of  the  questionnaire. 

On  the  basis  of  this  analysis,  I accepted  the  null 
hypothesis  A and  concluded  that  this  open-ended  section  of 
the  questionnaire  strongly  supported  the  validity  of  the 
1984  Patient  Satisfaction  Questionnaire. 

Procedure  3 . I followed  the  recommendations  of  Ware 
(1981)  that  satisfaction  researchers  conduct  an  item-analysis 
empirical  study  of  interrelationships  among  (a)  the  specific 
items  within  the  Patient  Satisfaction  Index  and  the  index 
itself  and  (b)  the  selected  domains  of  satisfaction  and 
the  satisfaction  index  (containing  three  domains  of  patient 
satisfaction . 


In  using  this  method,  I assumed  that  each  item  within 
a domain  contained  a substantial  amount  of  information  about 
respondents'  satisfaction  with  health  care  encounters  in 
the  subject  health  care  facility  as  well  as  information  about 
the  particular  domain  itself.  I tested  this  assumption  by 
correlating  each  item  with  the  index  (Hypothesis  B) . Using 
this  test  for  item  homogeneity,  items  that  belonged  in  the 
satisfaction  scale  should  correlate  substantially  (r  = .40, 

2 < . 05)  with  each  other  and  with  the  patient  Satisfaction 
Index.  Results  of  this  test  for  item  homogeneity  are 
included  in  Table  6.  I included  responses  from  users 
completing  all  items  in  the  patient  satisfaction  data  section 
of  the  questionnaire  in  this  analysis. 

Table  6 demonstrates  that  each  of  the  10  items  included 
in  the  patient  satisfaction  data  section  correlated 
significantly  (£  < .05)  with  the  index  with  a correlation 
coefficient  greater  than  .40.  The  intercorrelations  between 
items  1-6  (PR  and  PC  domains)  also  correlated  significantly 
(£  < •05l  with  each  other,  yielding  correlation  coefficients 
greater  than  .40.  Even  though  items  7-10  (CC  domain)  of 
the  patient  satisfaction  index  did  correlate  significantly 
with  the  index,  these  items  failed  to  correlate  significantly 
with  items  1-6.  The  results  of  this  correlation  matrix 
raised  questions  about  the  validity  of  the  cost/convenience 
domain  of  the  patient  satisfaction  data  section  of  this 
questionnaire . 
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Z also  used  factor  analysis  to  assess  the  homogeneity 
of  the  domains  included  in  the  patient  satisfaction  data 
section  of  the  questionnaire.  Each  domain  of  satisfaction 
should  also  correlate  substantially  with  the  index  to  be 
included  in  a patient  satisfaction  measurement  scale 
(Hypothesis  C) . The  correlation  matrix  for  this  test  of 
domain  homogeneity  is  included  in  Table  7. 


Correlation  Coefficient  Matrix  for 
the  Domains  of  Satisfaction  and  the  PSI 


0.46196  0.84336 
0.44076  0.83920 
1.00000  0.80828 


Note.  £ = .001  for  each  correlation  coefficient  in  the  matrix 


The  correlation  matrix  in  Table  7 supports  the  validity 
of  the  domains  of  satisfaction  forming  the  patient 
satisfaction  data  section  of  the  questionnaire.  Each  domain 
correlated  significantly  with  the  index  (r  ■ .40,  £ - .001). 
In  further  support  of  the  validity  of  the  questionnaire, 
the  correlation  between  each  domain  and  the  index  was 
stronger  than  the  correlation  between  the  same  domain  and 
each  of  the  remaining  two  domains  (Hypothesis  C) . The 
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correlation  matrix  in  Table  7 demonstrated  that  each  of 
the  three  domains  of  satisfaction  included  in  the  patient 
satisfaction  data  section  of  the  questionnaire  was 
strongly  associated  with  satisfaction  yet  each  measured  a 
distinct  aspect  of  the  construct,  satisfaction. 

Research  question  1 related  to  the  reliability  of  the 
1984  Patient  Satisfaction  Questionnaire.  The  mean  index 
value  of  a subject  of  the  population  who  completed  the 
questionnaire  at  the  initial  administration  was  compared  to 
the  mean  index  value  of  that  same  subset  of  respondents 
completing  the  questionnaire  from  2 to  4 weeks  later 
(Hypothesis  D) . Only  responses  from  those  users  completing 
the  entire  set  of  items  in  the  patient  satisfaction  data 
section  of  the  questionnaire  were  included  in  this  analysis. 

The  one-way  analysis  of  variance  procedure  I used  to 
determine  if  the  difference  between  the  two  groups  was 
significant  (test,  retest  validity),  produced  an  F value 
of  2.50  with  £ = . 1156 . Even  though  the  mean  of  the  initial 
questionnaire  administration  group  was  42.91  and  the  mean 


of  the  follow-up  questionnaire  administration  group  was 
41.603,  this  difference  was  not  significant  at  g < .05. 
This  analysis  (a)  led  to  the  conclusion  that  no 
significant  difference  existed  between  the  two  means  and 
(b)  supported  the  reliability  of  the  questionnaire  over 


Results  of  the  Data  Analysis  for  Testing  Research 
Hypotheses  Contained  in  Research  Question  2 

The  results  of  the  factorial  analysis-of  variance  (ANOVA) 
regression  procedure  used  to  test  the  10  null  hypotheses 
contained  within  Research  Question  2 are  reported  in 


Summary  Table  for  the  10-Factor  ANOVA  Regression  Analysis 


5.19 

0.16 

3.63 

0.24 

0.20 

0.35 


As  shown  in  Table  8,  significant  differences  between 
groups  formed  by  the  levels  of  the  10  grouping  variables  in 
the  respondent-reported  data  section  of  the  questionnaire 
occurred  in  only  two  of  the  10  items  included  in  the  analysis. 
The  Scheffe'  multiple  comparison  test  disclosed  where  specific 
differences  would  occur  between  levels  of  particular 
grouping  variables.  Results  were  as  follows: 

Hypothesis  G.  This  null  hypothesis  related  to  the 


respondent-reported  data 


respondents  were  asked  whether  they  were  or  were  not 
aware  of  the  appointment  system  at  the  student  health 
service.  An  F value  of  5.19,  2 = .024,  indicated  a 
significant  difference  between  the  mean  indices  of 
respondents  grouped  into  those  aware  (Group  A,  mean  index 
value  of  42.121)  and  those  unaware  (Group  B,  mean  index 
value  of  40.121)  of  the  appointment  system  at  the  facility. 
This  prompted  the  rejection  of  null  Hypothesis  G.  From 
this  analysis,  I concluded  that  of  those  users  who 
responded  to  the  principal  administration  of  the  1984 
Patient  Satisfaction  Questionnaire  and  completed  the  entire 
survey,  those  aware  of  the  appointment  system  were 
significantly  more  satisfied  than  were  those  respondents 
who  were  unaware  of  the  appointment  system. 

Hypothesis  I.  This  null  hypothesis  related  to  the 
fifth  respondent-reported  data  section  item  that  asked 
respondents  how  long  they  waited  to  see  a health  care 
provider  after  they  arrived  at  the  facility.  For  this  item, 
the  following  groups  were  formed  for  comparison  by  the 
four  response  choice  levels:  Group  A users  waited  less 

than  15  minutes;  Group  B users  waited  from  15  to  30 
minutes;  Group  c users  waited  from  30  to  60  minutes;  and 
Group  D users  waited  more  than  60  minutes.  The  significant 
F value  of  3.63,  2 = 0.0142  indicated  that  significant 
differences  existed  among  the  four  groups.  This  led  to 
the  rejection  of  null  Hypothesis  G.  The  results  of  the 
Scheffe  test,  which  demonstrated  where  differences  between 
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the  groups  existed,  are  reported  in  Table  9.  Study  group 
users  who  waited  less  than  15  minutes  were  more  satisfied 
with  health  care  provided  than  were  those  who  waited  15  to 


Scheffe  Comparisons  of  Group  Mean  Indices  Formed  by  the 
Levels  of  Question  E in  the  Respondent-Reported 
Data  Section  of  the  1984  Patient  Satisfaction  Questionnaire 


Hypotheses  E,  F.  H,  L,  M,  and  N.  These  hypotheses 
related  to  items  A,  B,  D,  H,  I,  and  J of  the  respondent- 
reported  data  section  of  the  questionnaire.  The  tests  of 
these  six  null  hypotheses  all  produced  F values  that  were 
not  significant,  resulting  in  the  acceptance  of  these  six 
null  hypotheses.  On  the  basis  of  this  research,  I concluded 
that  during  the  3-day  data-collection  period,  no  significant 


differences  in  group 


occurred  when  I grouped 
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users  by  (a)  university  classification,  (b)  number  of  times 
respondents  had  been  seen  by  health  care  providers  at  the 
facility,  (c)  whether  the  respondent  did  or  did  not  have 
an  appointment  for  the  visit,  (d)  total  time  spent  at  the 
health  care  facility,  (e)  whether  respondents  did  or  did 
not  have  health  insurance,  or  (f)  the  perceived  seriousness 
of  the  health  problem  predicating  the  respondent's  visit  to 
the  health  care  facility. 

Hypotheses  F and  G.  Two  factors  prevented  inclusion 
of  the  tests  for  Hypotheses  F and  G in  the  multiple  factor 
analysis  of  variance  regression  procedure:  (a)  some  groups 

formed  by  the  response  choice  levels  of  these  two 
questions  contained  no  respondents,  and  (b)  some  groups 
were  too  unbalanced  to  be  included  in  the  analysis 
procedures.  The  latter  situation  indicated  flaws  in  the 
construction  of  these  two  items.  The  final  chapter  contains 
a further  discussion  of  items  F and  G. 

Summary  of  Findings 

Findings  of  this  study  supported  the  validity  and 
reliability  of  the  1984  Patient  Satisfaction  Questionnaire. 
Mean  Patient  Satisfaction  Index  values  did  not  differ 
significantly  when  users  were  surveyed  immediately  after 
the  health  care  encounter  and  when  the  same  users  were 


surveyed  by  mail 


weeks  later. 
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satisfaction  with  the  subject  student  health  service  as 
measured  by  the  Patient  Satisfaction  Index  differed 
significantly  when  users  were  grouped  and  compared  based 
on  (a)  the  patient's  awareness  of  the  appointment  system 
at  the  subject  facility  and  (b)  the  length  of  time  the 
patient  waited  to  see  a health  care  provider  at  the  subject 

No  significant  differences  were  found  on  mean  index 
scores  when  users  were  grouped  and  compared  based  on 
(a)  university  classification,  (bl  the  number  of  times 
the  user  was  seen  by  a health  care  provider  at  the  subject 
facility,  (c)  whether  the  user  used  an  appointment  for  the 
visit  of  interest,  (d)  the  total  time  the  patient  spent 
during  the  health  care  encounter,  le)  whether  or  not  the 
patient  had  health  insurance,  and  { f ) the  perceived 
seriousness  of  the  health  problem  predicating  the  visit 
to  the  subject  student  health  service. 


RECOMMENDATIONS 


CHAPTER  V 

SUMMARY,  CONCLUSIONS,  AND 

The  literature  contains  documentation  of  the  need  to 
assess  users'  attitudes  toward  the  health  care  they  receive 
in  specific  settings.  Patient  satisfaction  research,  now 
conducted  in  many  health  care  settings,  has  progressed 
slowly  because  differing  needs  for  satisfaction  information 
have  resulted  in  the  creation  of  few  models  on  which  to 
base  replicative  studies.  Even  though  patient  satisfaction 
research  in  college  health  settings  has  become  increasingly 
popular  and  sophisticated,  research  in  this  rare  setting 
has  sometimes  yielded  data  of  questionable  value. 

This  study  was  an  effort  to  improve  upon  the  previous 
design  for  assessing  users'  perceptions  of  the  quality  of 
student  health  care  and  services  provided  by  a large 
southeastern  state  university,  as  one  step  toward  developing 
a model  for  the  profession. 

Summary 

Using  the  Campbell  and  Stanley  (1963)  Recurrent 
Institutional  Cycle  design,  I intended  (a)  to  establish 
the  basic  framework  for  a model  for  assessing  users' 
perceptions  of  the  quality  of  health  care  they  receive  in 
college-setting  student  health  services  and  (b)  to  provide 
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baseline  data  for  the  subject  health  service  for  the  cyclical 
part  of  the  ongoing  quality  assurance  program.  The  framework 
of  this  model  included  (a)  creation  of  an  assessment  instrument 
with  documented  reliability  and  validity,  (b)  testing  of  the 
instrument  in  one  student  health  service  at  two  different 
times,  and  (c)  the  provision  of  valid  and  reliable  user 
satisfaction  information  to  administrators  and  staff  of  the 
subject  facility. 

I developed  and  pretested  a questionnaire  including  a 
multidimensional  assessment,  that  yielded  a user  satisfaction 
index.  In  a 3-day  period  in  one  academic  term  (spring,  1984), 
952  users  visited  the  subject  health  service  during  regular 
operating  hours.  Almost  half  (409  or  42%)  completed  surveys. 

Of  those  who  agreed  to  participate  in  the  follow-up  survey, 

102  (64%)  returned  their  evaluations. 

The  index  was  formed  by  summing  users'  ratings  of 
satisfaction  and  dissatisfaction  concerning  10  neutrally 
stated  items.  I used  the  index  to  compare  (a)  the 
satisfaction  of  student  health  service  users  who  completed 
questionnaires  during  the  3-day  data-collection  period, 
when  grouped  by  their  self-reported  responses  to  10 
additional  questionnaire  items,  and  (b)  the  responses  of 
a subgroup  of  the  survey  respondents  on  questionnaires 
they  completed  immediately  after  the  health  care  encounter 
and  again  2 to  4 weeks  later. 

The  approach  to  examining  the  data  was  item  and  factor 
analysis  and  analysis  of  variance  regression.  I assessed 
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questionnaire  reliability  and  validity.  This  research 
generated  two  statistically  significant  findings  relating 
to  users  who  participated  in  the  initial  administration  of 
the  questionnaire:  (a)  those  aware  of  the  appointment  system 

were  more  satisfied  and  (b)  those  who  waited  less  than  15 
minutes  to  see  a health  care  provider  were  more  satisfied 
than  those  who  waited  15  to  60  minutes. 

The  final  effort  of  this  study  included  recommendations 
for  improving  patient  satisfaction  assessment  in  subsequent 
data-collection  cycles  in  the  subject  student  health  service. 

Because  of  the  multifaceted  nature  of  this  research 
effort,  conclusions  and  recommendations  relate  to  several 
aspects  of  the  study:  design  and  administration  of  the 

questionnaire,  and  data  analysis  and  findings. 

Design  and  Administration  of  the  Questionnaire 
The  design  and  method  of  administering  a patient 
satisfaction  assessment  instrument  is  of  utmost  importance 
to  those  who  will  use  the  information.  Patient  satisfaction 
investigators  can  generate  valuable  data  needed  to  plan, 
maintain,  modify,  and  improve  health  care  provision. 

Careful  design  and  administration  of  the  assessment 
instrument  and  reporting  of  the  analyzed  data  assures 
health  care  administrators  that  satisfaction  information 
generated  reflects  users'  perceptions  of  and  experiences 
in  the  health  care  facility  of  interest. 


When  subjective  data  is  collected  from  continually 
changing  groups  of  respondents  using  the  services  of  a 
particular  facility  (such  as  users  of  a university  student 
health  service) , investigators  are  afforded  the  opportunity 
to  improve  upon  (a)  the  design  and  method  of  administering 
the  assessment  instrument  and  (b)  the  methods  for  analysing 
data  generated  by  each  recurring  data-col lection  cycle. 

The  following  sections  of  this  chapter  contain  my 
conclusions  and  recommendations  for  improving  upon  the 
user  satisfaction  assessment  procedures  used  in  the  1984 
patient  satisfaction  data-collection  cycle. 

Conclusions  Relating  to  Questionnaire  Design 

Pretesting  of  the  assessment  instrument  resulted  in 
(a)  the  clarification  of  several  items,  (b)  simplification 
of  directions  for  completing  questionnaire  sections,  and 
(o)  selection  of  a questionnaire  format  that  was  more 
acceptable  to  respondents. 

I assessed  questionnaire  validity  according  to  the 
recommendations  of  Ware  (1981).  I based  the  domains  of 
satisfaction  in  the  questionnaire  scale  on  domains  defined 
by  Hulka  et  al.  (1975)  and  Ware  et  al.  (1976) . Also, 
inclusion  of  an  open-ended  item  to  expose  any  pertinent 
aspects  of  satisfaction  I might  have  omitted  from  the 
questionnaire  indicated  that  the  domains  of  satisfaction 
included  in  the  satisfaction  scale  were  acceptable. 
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Item  analysis  supported  the  content  validity  of  the 
10-item  satisfaction  scale  in  that  each  item-index 
correlation  coefficient  was  greater  than  .40,  with  a range 
of  .519  to  .765,  £ = .0001.  Factor  analysis  of  the  domains 
within  the  scale  supported  the  content  validity  of  the 
personal  relationship  (PR)  and  the  professional  competence 
(PC)  domains.  The  correlation  matrix  in  Table  5 demonstrated 
that  intercorrelations  of  items  within  each  domain  were 
greater  than  intercorrelations  of  items  between  these  two 
domains.  Item  analysis  of  the  cost/convenience  (CC)  domain 
produced  within-factor  item  and  between- factor  item 
correlation  coefficients  that  were  below  the  acceptable 
.40  level. 

Yet,  factor  analysis  of  the  domains  included  in  the 
scale  produced  acceptable  domain-index  correlation 
coefficients  as  follows:  PR  domain,  r = .843,  £ = .0001: 

PC  domain,  r - .839,  E = .0001;  and  CC  domain,  r = .808, 

£ = .0001.  Using  the  same  domains  of  satisfaction  for 
their  scale,  Zyzanski  et  al.  (1974)  reported  similar 
correlation  coefficients:  PR  domain,  r = .75;  PC  domain, 

r = .86;  and  CC  domain,  r = .68. 

The  results  of  the  analyses  of  questionnaire  validity 
described  in  the  preceding  paragraphs  supported  the  validity 
of  the  scale  items  and  domains  but  suggested  weaknesses 


within  the  CC  domain. 
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The  test-retest  evaluation  procedure  that  was  conducted 
as  an  integral  part  of  this  study  supported  the  reliability 
of  the  questionnaire  over  time. 

Conclusions  Relating  to  Questionnaire  Administration 

The  results  of  the  initial  survey  administration 
suggested  that  questionnaire  administration  procedures 
increased  the  number  of  users  surveyed  during  the  3-day 
data-eollection  period  over  returns  in  previous  years. 

The  presence  of  questionnaire  administration  personnel 
appeared  to  have  had  a positive  impact  on  data-collection 
management. 

During  the  follow-up  data-collection  activities,  one 
problem  with  questionnaire  administration  became  evident. 
Unexpected  delays  with  campus  postal  procedures  and 
problems  associated  with  the  misprinted  bulk-rate  permit 
number  (referred  to  in  Chapter  III)  resulted  in  inadequate 
time  for  students  (users)  to  complete  and  return  follow-up 
questionnaires  before  the  final  week  of  the  academic  term. 

By  the  time  I could  determine  which  respondents  had  not 
returned  questionnaires,  the  majority  of  follow-up 
participants  had  left  the  campus  area  for  the  between-terms 
break.  The  impressive  644  return  rate  might  have  been 
even  larger  if  time  and  circumstances  had  allowed  an 
additional  follow-up  contact  with  those  who  failed  to 
return  the  mailed  survey. 


A related  factor  that  jeopardized  the  representativeness 
of  the  sample  populations  in  both  questionnaire 
administrations  was  the  failure  of  25%  of  the  respondents 
to  complete  the  entire  patient  satisfaction  data  section 
of  the  questionnaire.  These  respondents  did  not  select 
the  unable  to  answer  response  choice  on  some  items  yet 
failed  to  check  any  of  the  response  choices.  At  this  time, 

I cannot  determine  if  respondents  failed  to  understand 
these  items  or  merely  skipped  some  items  in  this 
questionnaire  because  of  time  pressures  associated  with 
university  life.  I contend  that  patients  who  visited  the 
facility  only  to  use  the  pharmacy  may  have  been  confused 
by  these  items  since  they  did  not  readily  apply  to  their 
visit — the  subject  of  the  satisfaction  assessment. 

Strategies  for  improving  upon  this  situation  will  be 
discussed  in  the  recommendations  section  of  this  chapter. 

Data  Analysis  and  Findings 
I analyzed  the  data  using  analysis  of  variance 
regression  procedures  and  tested  14  null  hypotheses.  This 
effort  generated  two  statistically  significant  findings: 

(a)  users  who  participated  in  the  initial  survey  administration, 
who  were  aware  of  the  appointment  system  at  the  subject 
facility  had  significantly  higher  patient  satisfaction 
indices  than  did  users  who  were  unaware  of  this  system,  and 

(b)  users  participating  in  the  initial  administration  of  the 


survey  who  waited  less  than  15  minutes  to  see  a health 
care  professional  had  significantly  higher  satisfaction 
indices  than  those  who  waited  from  15  to  60  minutes. 

No  significant  differences  emerged  in  mean  patient 
satisfaction  indices  when  I grouped  respondents  by  (a) 
university  classification,  (b)  the  number  of  previous 
visits  to  the  facility,  (c)  whether  the  respondent  did  or 
did  not  have  an  appointment  for  the  visit,  (d)  the  type  of 
health  care  provider  seeing  the  respondent,  (e)  total  time 
spent  in  the  subject  health  care  facility,  (f)  whether 
the  respondent  did  or  did  not  have  health  insurance,  and 
(g)  the  user's  perceived  seriousness  of  the  health  matter 
predicating  the  visit  to  the  health  service. 

Additionally,  no  significant  differences  existed  in 
the  mean  Patient  Satisfaction  Indices  of  the  subgroup  when 
these  respondents  completed  the  questionnaire  immediately 
after  the  health  care  encounter  and  then  again  2 to  4 
weeks  later. 

Considering  the  goals  of  this  research  project,  I 
concluded  that  the  data-analysis  procedures  were  appropriate. 
The  project  goal  was  not  only  to  establish  a tested  model 
for  assessing  patient  satisfaction  and  generate  baseline 
user  satisfaction  data  for  one  health  care  service,  but  to 
provide  a basis  for  continued  improvement  of  this  model  and 
its  associated  methods  with 


each  recurring  patient 


satisfaction  data-collection  cycle.  The  overall  success 
or  failure  of  this  research  project  will  be  evident  in 
subsequent  years. 

Even  though  the  nonrandomly  selected  study  group 
limited  generalizability  of  this  research  effort,  the  two 
significant  findings  generated  by  this  study  suggest  a need 
for  (a)  additional  efforts  to  educate  students  of  the 
subject  university  on  how  to  make  best  use  of  the  student 
health  service  and  (b)  a highly  efficient  health  service 
operation  employing  strategies  to  minimize  waiting  time 
associated  with  using  the  subject  facility  and  services. 

With  the  improvements  to  the  revised  1985  Patient 
Satisfaction  Questionnaire  recommended  in  subsequent 
sections  of  this  chapter,  this  instrument  could  be  adapted 
to  meet  the  satisfaction  information  needs  of  other  college 
health  service  administrators.  Arrangements  have  already 
been  confirmed  for  the  replication  of  this  study  using  a 
revised  and  adapted  form  of  the  1984  Patient  Satisfaction 
Questionnaire  that  includes  the  recommended  changes.  This 
replicative  study  will  take  place  in  a private  northeastern 
university  student  health  service  setting. 

Discussion  of  the  1984  Instrument 

Questionnaire  administration  personnel  provided  valuable 
information  relating  to  the  design  of  the  instrument.  These 
assistants  reported  that 


respondents  appeared  to  lack 
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knowledge  of  student  health  service  staff,  procedures, 
and  services  offered — information  they  needed  to  answer 
items  F and  G in  the  respondent-reported  data  section  of 
the  questionnaire  (item  F,  By  which  health  care  providers 
were  you  seen?  and  item  G,  What  services  did  you  use?) 

Questionnaire  administration  personnel  also  reported 
that  frequent  questions  from  respondents  about  item  I 
in  the  same  section  of  the  questionnaire  (Do  you  have  health 
insurance?) , indicated  that  some  users  were  confused  about 
the  difference  in  having  paid  the  health  fee  and  in  having 
health  insurance. 

Even  though  the  data  generated  by  these  items  was 
suspect — or  because  it  was  suspect — the  items  did  provide 
valuable  information  on  respondents'  lack  of  knowledge  about 
student  health  service  structure  and  function.  Confusion 
about  these  three  items  mentioned  above  that  were  included 
in  the  respondent-reported  data  section  of  the  questionnaire 
supports  the  need  for  strategies  to  educate  students  of  the 
subject  university  on  how  best  to  use  their  student  health 
service  facility. 

Other  problem  areas  of  the  questionnaire  focus  on 
(a)  a need  for  additional  demographic  data  items  in  the 
respondent-reported  data  section  and  (b)  revision  of  several 
items  in  the  same  section  of  the  questionnaire  to  facilitate 
completion  of  the  survey.  Item  A in  this  section  (What  is 
your  university  classification?)  might  produce  more  valuable 


information  if  it  was  replaced  by  five  items  as  follows: 
one  question  each  asking  (a)  the  age  of  the  respondent, 

(b)  sex  of  the  respondent,  (c)  ethnic  origin  of  the  respondent, 
(d)  how  long  the  respondent  has  attended  the  subject 
university,  and  (e)  whether  the  respondent  lives  on-  or 
offcampus.  With  such  modifications,  these  items  would 
become  grouping  variables  for  comparing  mean  scores  on  the 
Patient  Satisfaction  Index. 

The  item  asking  for  the  respondent's  age,  sex,  ethnic 
origin,  and  place  of  residence  would  provide  additional 
demographic  data  on  respondents  useful  for  (a)  making 
additional  comparisons  of  levels  of  satisfaction  based  on 
the  mean  Patient  Satisfaction  Indices  of  groups  of  users 
categorized  by  responses  to  these  items,  (b)  comparing 
those  responding  and  those  failing  to  respond  to  the 
follow-up  administration  of  the  questionnaire,  and  (c) 
characterizing  users  of  the  subject  facility — information 
that  would  be  needed  in  the  future  when  an  instrument  will 
be  designed  for  investigating  usage  of  the  subject  facility. 

The  fourth  additional  comparison  suggested  above  (how 
long  the  respondent  had  attended  the  subject  university) 
may  indicate  that  users  who  had  been  at  the  university  for 
longer  and  had  had  more  opportunities  to  use  the  student 
health  service  may  have  been  more  familiar  with  the  facility, 
staff,  procedures,  and  services,  and,  consequently,  might  have 


satisfied  with 


they  received. 
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The  revision  of  an  item  that  would  separate  out  users 
who  visited  the  student  health  service  pharmacy  only  would 
reduce  respondent  confusion  in  completing  questionnaires. 
Completion  of  the  patient  satisfaction  data  section  of  the 
questionnaire  is  appropriate  for  those  visiting  the  pharmacy 
only.  A considerable  number  of  respondents  had  visited 
the  student  health  service  only  to  use  the  pharmacy.  This 
resulted  in  numerous  questionnaires  being  returned  to 
questionnaire  administration  personnel  with  an  incomplete 
patient  satisfaction  data  section.  This  could  be  easily 
remedied  by  changing  the  order  of  questionnaire  items  in 
this  section. 

Revision  of  items  7,  8,  9,  and  10  in  the  patient 
satisfaction  data  section  of  the  questionnaire  (item  7,  the 
cost  of  my  student  health  service  visit;  item  8,  the  time  1 
spent  waiting  to  see  a health  care  provider:  item  9,  the 
convenience  of  using  student  health  service  for  mv  health 
care  needs;  and  item  10,  the  physical  environment  within  the 
student  health  servicel  would  clarify  these  items  and 
facilitate  completion  of  the  survey.  These  items  were 
based  on  findings  of  other  pertinent  satisfaction  investigators. 
Clarification  of  these  items  may  improve  item  and  factor 
analyses  of  the  CC  domain  to  be  used  in  the  1985  Patient 
Satisfaction  Questionnaire.  Also,  variability  of  the 
satisfaction  indices  may  be  increased  if  items  in  this  section 
are  worded  positively  and  negatively. 
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Furthermore,  the  questionnaire  would  be  improved  if 
those  respondents  visiting  the  subject  facility  for  pharmacy 
services  only  were  instructed  to  disregard  the  patient 
satisfaction  data  section  of  the  survey.  Pharmacy-only 
respondents  should  be  excluded  from  the  follow-up 
procedures. 

Recommendations  for  Subsequent 

Ps-L.;:;- 

In  this  section,  recommendations  are  made  for  the  next 
two  patient  satisfaction  data  collection  cycles  in  the 
subject  student  health  service.  My  most  general  recommendation 
for  the  next  data-collection  cycle  is  for  investigators  to 
once  again  assess  user  satisfaction  with  the  subject  facility 
using  the  subject  questionnaire  including  (a)  the  recommended 
revisions  that  follow  and  (b>  the  already-established 
follow-up  questionnaire-administration  procedures  for 
assessing  the  reliability  of  the  revised  questionnaire. 

Specific  recommendations  focus  on  changes  to  (a)  the 
1984  Patient  Satisfaction  Questionnaire  and  its  pretesting 
and  (b)  the  methods  for  administering  the  initial  and  follow-up 
surveys.  My  final  recommendations  focus  on  the  creation  of 
two  additional  instruments  with  which  to  explore  (a)  factors 
affecting  access  to  and  usage  of  the  subject  student  health 
service  and  (b)  the  levels  of  satisfaction  and  dissatisfaction 
of  those  using  the  Mental  Health  Division  of  the  subject  facility. 
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Revision  of  the  1984  Patient  Satisfaction  Questionnaire 

Based  on  the  findings  of  this  research  study,  I 
recommend  the  following  changes  be  made  to  the  design  of 
the  1984  Patient  Satisfaction  Questionnaire  before  the  next 
administration  of  the  questionnaire. 

1.  Revise  the  cover  letter  of  the  questionnaire  so 
that  respondents  are  informed  (a)  that  data  they  provide 
will  be  used  in  a replicative  research  study,  (b)  that  the 
investigators  hope  to  publish  the  results  of  this  ongoing 
project  designed  to  improve  the  provision  of  health  care 
and  services  in  the  subject  facility,  (c)  that  they  will 
be  ashed  to  participate  in  a follow-up  study  that  is  an 
integral  part  of  the  research  project,  and  (d)  that 
nonparticipation  in  the  study  will  not  be  penalized. 

The  following  recommendations  pertain  to  the  general 
respondent  data  section  of  the  1984  Patient  Satisfaction 
Questionnaire. 

2.  Add  the  five  demographic  items  described  in  the 
discussion  section  of  this  chapter  to  the  respondent-reported 
data  section  of  the  questionnaire,  with  the  inclusion  of 
these  items,  the  questionnaire  should  be  reviewed  and 
approved  by  the  Committee  on  Human  Subjects  Research  of 

the  subject  university. 

3.  Revise  item  E (Purina  this  visit,  how  long  did 
you  wait  to  see  a health  care  provider?)  by  eliminating 
the  fourth  response  choice  and  rewording  the  preceding 
choice.  As  only  2%  of  respondents  waited  over  60  minutes, 


this  response  choice  should  be  combined  with  the  preceding 
choice  so  that  it  reads,  Over  30  minutes  (see  Appendix  F) . 

4.  Retain  item  F IBv  which  health  care  providers  were 
you  seen?)  as  it  appeared  in  the  1984  Patient  Satisfaction 
Questionnaire  in  order  to  determine  if  measures  taken  since 
the  subject  data  collection  to  correct  the  situation  of 
students  being  unaware  of  the  medical  specialty  of  the  health 
care  professional  providing  them  services  were  successful. 

The  revised  questionnaire  item  could  also  be  educational  if 
it  was  preceded  by  a brief  statement  explaining  the  function 
of  the  screening  clinic. 

5.  Revise  item  H (What  was  your  total  time  spent  at 
Student  Health  Service?)  by  eliminating  the  fourth  response 
choice  and  revising  the  preceding  choice.  As  only  5.78  of 
respondents  were  at  the  subject  facility  over  90  minutes, 
this  response  choice  should  be  combined  with  the  preceding 
choice  so  that  it  reads.  Over  60  minutes  (see  Appendix  F) . 

6.  Revise  item  I (Do  you  have  health  insurance?!  to 
include  a statement  reminding  respondents  that  full-time 
students  must  pay  and  part-time  students  elect  to  pay  the 
health  fee.  This  added  statement  might  be  followed  by  the 
questions.  Have  you  paid  the  health  fee?  and  Do  you  have 
health  insurance  to  cover  fees  for  services  not  covered  bv 
the  payment  of  the  health  fee? 

7 . Eliminate  item  J (In  your  opinion,  how  serious  was 
the  health  problem  that  caused  you  to  visit  Student  Health 
Service?)  because  the  findings  of  this  study  relating  to 
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this  item  concurred  with  the  findings  of  studies  cited  in 
Chapter  II. 

8.  Include  and  revise  item  G (What  services  did  you 
use?)  and  place  it  as  the  final  question  in  the  general 
respondent  data  section  of  the  questionnaire.  The  first 
response  choice  for  this  item  could  read,  I visited  the 
Student  Health  Service  Pharmacy  only  and  did  not  use  other 
health  care  providers  for  services.  This  response  choice 
should  be  followed  by  instructions  telling  these  respondents 
to  skip  the  patient  satisfaction  data  section  and  proceed 

to  the  comments /suggestions- for- improvement  section  of  the 
questionnaire.  In  this  way,  pharmacy-only  users  (a)  would 
not  be  asked  to  complete  an  inappropriate  section  of  the 
survey,  and  (b)  could  be  excluded  from  analyses  focusing  on 
quality  of  care  delivered. 

Recommendations  for  Questionnaire  Administrations 

My  recommendations  for  questionnaire  administrations 
during  the  next  cycles  of  patient  satisfaction  data 
collection  include  the  following  items. 

9.  Pretest  the  revised  questionnaire  in  the  subject 
student  health  facility  with  a greater  number  of  users 

in  order  to  identify  problems  that  may  not  surface  when 
pretesting  is  accomplished  (a)  outside  the  subject  facility 
and  (b)  with  a small  number  of  respondents. 

10.  Attempt  to  survey  an  even  higher  percentage  of 
initial  survey  administration  respondents  by  stationing 


126 


questionnaire  administration  personnel  at  all  exits  of  the 
subject  facility. 

11.  Elicit  the  involvement  of  additional  subject-facility 
staff  members  in  the  data-collection  procedures.  The  subject 
study  demonstrated  (a)  the  value  of  questionnaire  administration 
personnel  in  increasing  the  percentage  of  users  surveyed  during 
the  data-collection  period  and  (b)  the  need  for  additional 
volunteers  to  serve  in  this  capacity.  During  this  study, 
subject-facility  staff  members  expressed  their  interest  in 

and  desire  to  be  involved  in  the  next  data-collection  cycle. 

12.  Improve  the  training  of  questionnaire  administration 
personnel  in  order  to  minimize  the  possibility  of  their 
biasing  study  participants'  responses  to  questionnaire  items. 

13.  Plan  for  data  collection  to  occur  immediately  after 
mid-semester  examinations  to  allow  more  time  for  contacting 
follow-up  participants  who  fail  to  respond. 

14.  Use  first-class  mail  for  administering  the 
follow-up  questionnaire. 

15.  Attempt  to  increase  the  return  rate  of  follow-up 
questionnaire-administration  respondents  by  making  telephone 
calls  to  those  who  fail  to  respond. 

16.  Since  the  above  changes  will  result  in  a slightly 
longer  instrument,  I recommend  that  the  revised  survey  (a) 
be  typeset  so  that  it  will  appear  no  longer  than  the  1984 
version  used  in  this  study  and  (b)  be  printed  on  high-quality, 
yellow  paper  for  the  initial  administration  and  blue  paper 
for  the  follow-up  administration  of  the  questionnaire. 
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The  following  recommendations  pertain  to  the  patient 
satisfaction  data  section  of  the  questionnaire. 

17.  Revise  this  entire  section  of  the  questionnaire  so 
that  items  are  written  as  positive  or  negative  rather  than 
neutral  statements  relating  to  the  three  domains  of 
satisfaction  verified  by  the  results  of  data  analyses 
contained  in  Chapter  IV.  Using  the  procedures  recommended 
by  Ware  (1981)  for  generating  positive  and  negative 
statements  relating  to  each  of  the  three  domains , I 
recommend  (a)  that  numerous  positive  and  negative  statements 
be  written  reflecting  the  same  content  as  the  items  used 
in  the  patient  satisfaction  data  section  of  the  1984 
questionnaire  and  (b)  using  the  Thurstone  Method  of 
Equal-Appearing  Intervals  and  a panel  of  expert  judges 
described  in  Chapter  II,  generate  10  items  with  the  same 
content  as  those  items  used  in  the  1984  questionnaire, 
five  of  which  are  positively  written  and  five  of  which  are 
negatively  written. 

The  scale  would  be  modified  to  reflect  the  respondent's 
agreement  or  disagreement  with  the  10  new  items.  Scoring 
procedures  for  the  creation  of  the  Patient  Satisfaction 
Index  would  be  unchanged  for  positive  statements  and 
reversed  for  negative  statements  using  the  following  scales: 
a.  On  positively  stated  items,  strongly  agree  = 5, 
agree  - 4,  neutral  ■ 3,  disagree  - 2,  strongly  disagree  - 1, 
to  answer  will  remain  valueless. 


128 


b.  On  negatively  stated  items,  strongly  agree  = 1, 
agree  = 2,  neutral  = 3,  disagree  = 4,  strongly  disagree  - 5, 
and  unable  to  answer  will  remain  valueless. 

The  10  value-coded  ratings  of  survey  respondents  will  still 
be  summed  to  create  the  Patient  Satisfaction  Index. 

According  to  Ware  (1981)  this  revised  section  of  the 
questionnaire  with  positive  and  negative  statements  should 
result  in  more  variability  in  the  Patient  Satisfaction  Indices 
of  respondents. 

The  remaining  three  recommendations  relate  to  future 
patient  satisfaction  data-collection  cycles. 

18.  Create  an  additional  Patient  Satisfaction 
Questionnaire  for  assessing  users'  perceptions  of  the 
care  they  receive  in  the  Mental  Health  section  of  the 
student  health  service  facility  because  (a)  the  subject 
questionnaire  may  be  inappropriate  for  users  of  student 
health  service  Mental  Health  Division,  and  (b)  users  of 
these  services  were  underrepresented  in  this  study.  During 
the  1983-84  fiscal  year,  10.48%  of  those  visiting  the  subject 
facility  received  Mental  Health  Division  services;  during 
March,  1984,  7.57%  received  Mental  Health  Division  services; 
and  during  the  3-day  data-collection  period,  only  2%  of 
respondents  had  visited  the  subject  Mental  Health  Division. 

19.  Recommendations  for  data  analyses  are  difficult 
to  make  until  one  defines  the  research  questions  for  a 
particular  study.  The  general  recommendation  that  would 
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have  the  greatest  impact  on  patient  satisfaction  assessment 
research  in  a given  student  health  service  is  the  creation 
of  an  additional  questionnaire  that  would  generate  information 
on  (a)  usage  of  the  subject  facility  and  (b)  factors  affecting 
usage  of  and  access  to  the  subject  student  health  service. 

This  additional  questionnaire  would  allow  investigators  to 
compare  respondents  on  the  basis  of  whether  they  were  users 
or  nonusers  for  the  purpose  of  identifying  barriers  to  access 
and  for  taking  action  to  remove  those  barriers.  I further 
recommend  the  use  of  stratified  random  sampling  procedures 
for  selection  of  the  study  group  to  be  examined  by  this 
additional,  recommended  research  effort. 

20.  Finally,  on  the  assumption  that  adequate  personnel 
and  funding  were  available,  I recommend  (a)  the  assessment  of 
user  satisfaction  take  place  each  fall  academic  term  and  (b) 
the  assessment  of  usage,  satisfaction,  and  the  identification 
of  factors  affecting  usage  of  and  access  to  the  subject 
facility  take  place  each  spring  academic  term.  The  addition 
of  this  usage  assessment  would  produce  a more  sound  and 
comprehensive  quality  assurance  tool. 

In  summary,  users  participating  in  this  study  were 
very  satisfied  with  health  care  received  at  the  subject 
health  service.  This  study  resulted  in  the  following  changes 
to  student  health  service  procedures:  (a)  increased  efforts  to 

educate  users  on  using  the  service;  (b)  inservice  education 
programs  to  increase  staff  awareness  of  problems  facing  users; 
and  (o)  the  streamlining  of  check-in  procedures  at  the  subject 


facility. 
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COMMENTS/ SUGGESTIONS  FOR  IMPROVEMENT 
Please  be  as  specific  as  possible. 
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COMMENTS/SUGGESTIONS  FOR  IMPROVEMENT 
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Comments/Suggestions  for  Improvement 


Of  the  406  PSS  questionnaires  completed  during  March  28-30,  1984,  126 
included  comments/suggestions.  This  open-ended  section  of  the  questionnaire 
is  particularly  important  because  it  provides  an  additional  means  of 
assessing  validity  of  the  PSS  questionnaire.  Patient  satisfaction  assessment 
is  a continuing  process  which  requires  that  the  assessment  instrument  be 
Improved  with  each  administration.  Numerous  comments  on  patient  satisfaction 
issues  not  addressed  in  the  PSS  instrument  identify  variables  that  should  be 
included  in  the  revised  questionnaire.  The  open-ended  section  also  provides 
respondents  an  opportunity  to  single  out  aspects  of  satisfaction  with  health 
care  about  which  they  feel  most  strongly. 

Many  have  argued  that  the  typical  college  health  service  user  is  not 
qualified  to  judge  quality  of  health  care.  Whether  qualified  or  not,  SHS 
users  still  make  these  judgments  which  influence  their  use  of  campus  health 
services.  Users  probably  share  their  evaluations  of  SHS  with  their  peers 
broadening  the  impact  of  these  judgments  and  underscoring  their  importance. 

The  comments/suggestions  following  do  not  necessarily  represent 
majority  opinion  but  rather  the  range  of  responses.  Some  reflect  a lack  of 
awareness  of  health  care  services  in  general.  Others  reflect  a lack  of 
awareness  of  SHS  services  and  procedures.  Comments  about  dissatisfaction 
with  quality  of  care  and  staff  seem  to  relate  to  specific  instances  of 
care  and  are  undoubtedly  colored  by  influences  other  than  what  is  reported 
in  these  brief  patient  statements. 

Subjective  data  from  the  open-ended  section  has  been  categoriled  as 
follows:  issues  concerning  access,  such  as  cost,  convenience,  making 
appointments,  waiting  and  insurance  issues;  issues  concerning  quality  of 
care/staff,  such  as  sensitivity,  medical  competence,  staffing,  comments 
on  specific  clinics/services;  issues  concerning  the  SHS  facility;  and 
suggestions  for  improvement  of  SHS. 
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Suggestions  continued 

The  waiting  is  usually  almost  intolerable.  I think  if  rhe  aooo 
system  were  pushed  a little  more,  the  wait  would  not  be  so  bad  I 
there  would  not  be  as  many  walk-ins. 


1 personnel  should  wi 


I usually  have  better,  faster  service 
It  takes  too  many  days  to  get  an  appoi 
women's  Clinic.  Hire  a dermatologist. 


visible  name  tags  with  their  job  on  it.  Often 
a nurse  from  a doctor  from  a medical  student, 
iter  service  from  walk-in  than  appointment. 

"°f  *"  * — — * ueed  more  staff  for  the 
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